-- Logs begin at Thu 2021-12-16 13:46:27 UTC, end at Thu 2021-12-16 15:02:06 UTC. -- Dec 16 14:30:23.685562 dv-cinder-821892-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 16 14:30:23.695750 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 16 14:30:23.697714 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 16 14:30:23 2021] *** Dec 16 14:30:23.697714 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 16 14:30:23.697714 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 16 14:30:23.697714 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: nodename: dv-cinder-821892-3-iscsi Dec 16 14:30:23.697714 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: machine: x86_64 Dec 16 14:30:23.697714 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: clock source: unix Dec 16 14:30:23.697714 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: pcre jit disabled Dec 16 14:30:23.697714 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: detected number of CPU cores: 4 Dec 16 14:30:23.697714 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: current working directory: / Dec 16 14:30:23.697714 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: detected binary path: /usr/bin/uwsgi-core Dec 16 14:30:23.698919 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: your processes number limit is 47680 Dec 16 14:30:23.698919 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: your memory page size is 4096 bytes Dec 16 14:30:23.698919 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: detected max file descriptor number: 2048 Dec 16 14:30:23.698919 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: lock engine: pthread robust mutexes Dec 16 14:30:23.698919 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: thunder lock: enabled Dec 16 14:30:23.698919 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 16 14:30:23.698919 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 16 14:30:23.738642 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: Python main interpreter initialized at 0x5648ab1d59c0 Dec 16 14:30:23.738642 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: python threads support enabled Dec 16 14:30:23.738642 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: your server socket listen backlog is limited to 100 connections Dec 16 14:30:23.738642 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: your mercy for graceful operations on workers is 90 seconds Dec 16 14:30:23.739045 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 14:30:23.739045 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: *** Operational MODE: preforking *** Dec 16 14:30:23.739335 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: *** uWSGI is running in multiple interpreter mode *** Dec 16 14:30:23.739335 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: spawned uWSGI master process (pid: 87107) Dec 16 14:30:23.739523 dv-cinder-821892-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 16 14:30:23.740239 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: spawned uWSGI worker 1 (pid: 87108, cores: 1) Dec 16 14:30:23.740426 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: spawned uWSGI worker 2 (pid: 87109, cores: 1) Dec 16 14:30:23.740580 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 14:30:27.745807 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:30:27.746537 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:30:27.746537 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:30:27.746863 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:30:27.747120 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:30:27.747509 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.747836 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.748158 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.748483 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.748846 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.749157 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.749478 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.749799 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.750128 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.750388 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.750705 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.751029 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821892-3-iscsi {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.751352 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.751659 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.751743 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:30:27.752132 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:30:27.752217 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.752305 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.752382 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:30:27.752587 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.752752 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:30:27.752913 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.753033 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:30:27.753228 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.753427 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.753722 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.753840 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.754851 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.754970 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755054 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755131 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755197 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755268 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755334 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755406 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755473 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755544 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755609 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755679 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.755965 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.756092 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.756204 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.756297 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.756525 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.756670 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.756879 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821892-3-iscsi {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.756978 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.757209 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.757356 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821892-3-iscsi {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.757519 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.757617 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.759459 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.759627 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.759779 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.759873 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.759873 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760018 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760111 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760191 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760327 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760419 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760419 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760562 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760651 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760729 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760821 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760914 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.760994 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.761080 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.761158 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.761234 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.761370 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.761462 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.761548 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.761627 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.761711 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.761788 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.761935 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.762023 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.762244 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.762330 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.762567 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.762660 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.762876 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.762982 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821892-3-iscsi {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.763183 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.763294 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.763434 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.763524 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.763732 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.763825 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.764056 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.764218 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.764376 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.764531 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.764701 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.764922 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.765071 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.765209 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.765354 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.765493 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.765631 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.765782 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.765919 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.766111 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.766271 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.766429 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.766567 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.766718 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.766868 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.767019 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.767164 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.767325 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.767485 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.767622 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.767766 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.767906 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.768047 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.768191 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.768351 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.768495 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.768645 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.768842 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.769007 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.769158 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.769257 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.769349 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.769429 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.769674 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.769908 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.770052 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.770215 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.770371 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.770522 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.770659 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.770795 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.770951 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.771093 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.771233 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.771379 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.771580 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.771719 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.771973 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.772121 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.772264 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.772458 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.772613 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.772765 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.772981 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.773122 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.773375 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.773569 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.773707 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.773872 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.774028 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.774168 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.774313 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.774450 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.774546 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.774814 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.774969 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.775138 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.775285 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.775430 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.775570 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.775724 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.775876 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.776528 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.776628 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.776857 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.776984 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.777169 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.777396 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.777483 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.777651 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.777772 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.777962 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.778081 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.778308 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.778402 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.778632 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.778725 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.778943 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.779031 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.779264 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.779350 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.779569 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.779676 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.779887 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.780023 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.780192 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.780280 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.780499 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.780623 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.780855 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.780959 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.781148 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.781235 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.781455 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.781540 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.781705 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.781799 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.782008 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.782111 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.782313 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.782418 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.782630 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.782725 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.782938 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.783040 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.783245 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.783332 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.783552 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.783639 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.783854 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.783940 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.784162 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.784316 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.784467 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.784554 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.784768 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.784884 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.785105 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.785202 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.785412 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.785498 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.785719 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.785805 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.786025 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.786118 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.786331 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.786423 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.786633 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.786724 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.786939 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.787034 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.787246 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.787333 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.787551 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.787636 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.787855 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.787949 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.788156 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.788254 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.788457 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.788542 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.788813 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.788905 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.789105 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.789201 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.789410 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.789501 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.789718 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.789805 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.790027 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.790178 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.790332 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.790424 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.790651 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.790739 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.790958 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.791053 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.791265 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.791351 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.791608 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.791696 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.792551 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.792648 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.792887 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.792988 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.793204 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.793291 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.793521 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.793609 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.793853 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.793943 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.794168 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.794256 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.794482 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.794568 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.794796 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.794890 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.795116 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.795202 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.795436 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.795541 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.795762 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.795865 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.796060 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.796183 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.796383 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.796468 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.796702 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.796820 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.797040 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.797128 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.797359 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.797452 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.797690 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.797785 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.798013 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.798099 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:30:27.798327 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.798416 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.798670 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.798758 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.799015 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.799100 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.799330 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.799414 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.799659 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.799753 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.799974 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.800137 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.800555 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.800681 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.800936 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.801021 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.801176 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.801277 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.801495 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.801609 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.801805 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.801892 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.802117 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.802203 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.802426 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.802518 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.802746 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.802840 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.803070 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.803217 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.803380 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.803476 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.803691 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.803785 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.804002 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.804100 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.804308 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.804402 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.804618 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.804705 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.804948 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.805036 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.805276 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.805372 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.805608 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.805696 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.805920 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.806013 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.806272 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.806413 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.806566 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.806768 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.806880 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.807091 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.807208 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.807457 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.807545 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.807772 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.807859 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.808124 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.808212 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.808433 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.808519 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.808765 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.808931 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.809101 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.809197 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.809410 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.809496 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.809730 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.809816 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.810039 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.810133 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.810352 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.810430 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.810673 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.810749 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.810988 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.811078 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.811298 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.811373 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.811612 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.811719 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.811941 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.812041 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.812225 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.812310 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.812534 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.812618 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.812885 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.812975 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.813216 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.813297 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.813525 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.813602 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.813920 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.814009 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.814162 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.814237 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.814476 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.814552 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.814784 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.814867 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.815090 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.815172 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.815396 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.815471 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.815705 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.815782 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.816009 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.816085 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.816318 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.816399 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.816627 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.816704 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.816960 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.817047 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.817344 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.817443 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.817618 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.817776 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.817924 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.818066 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.818221 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.818374 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.818520 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.818666 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.818818 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.818970 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.819121 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.819274 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.819425 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.819576 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.819721 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.819865 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.820026 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.820193 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.820348 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.820492 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.820642 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.820818 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.820980 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.821134 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.821320 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.821478 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.821624 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.821767 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.821921 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.822151 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.822315 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.822461 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.822605 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.822756 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.822978 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.823125 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.823270 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.823414 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.823558 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.823702 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.823931 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.824176 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.824334 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.824498 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.824643 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.824844 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.824844 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.825155 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.825311 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.825455 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.825606 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.825751 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.825903 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.826056 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.826241 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.826393 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.826552 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.826705 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.826850 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.827001 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.827148 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.827292 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.827292 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.827577 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.827731 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.827876 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.828019 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.828163 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.828325 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.828480 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.828625 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.828770 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.828949 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.829103 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.829249 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.829405 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.829551 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.829695 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.829844 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.829990 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.830141 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.830297 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.830441 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.830585 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.830728 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.830871 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.831023 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.831168 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.831313 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.831455 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.831455 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.831726 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.831726 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.832015 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.832187 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.832406 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.832563 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.833222 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.833397 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.833552 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.833699 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.833849 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.833994 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.834157 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.834388 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.834548 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.834695 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.834851 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.834996 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.835149 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.835305 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.835451 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.835596 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.835596 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.835868 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.836021 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.836166 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.836310 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.836453 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.836598 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.836752 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.836958 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.837105 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.837249 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.837392 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.837535 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.837679 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.837833 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.837977 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.838127 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.838271 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.838414 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.839055 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.839220 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.839373 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.839518 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.839663 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.839806 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.839958 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.840110 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.840262 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.840414 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.840558 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.840704 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.840881 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.841030 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.841191 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.841337 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.841480 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.841624 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.841777 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.841777 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.842066 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.842211 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.842355 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.842587 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.842753 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.842908 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.843070 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.843216 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.843366 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.843519 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.843665 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.843809 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.843955 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.844099 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.844243 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.844412 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.844655 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.844833 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.844985 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.845140 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.845305 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.845460 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.845615 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.845761 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.845905 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.846049 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.846192 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.846344 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.846489 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.846633 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.846847 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.847019 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.847188 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.847334 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.847479 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.847631 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.847776 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.847920 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.848074 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.848227 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.848373 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.848516 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.848661 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.848824 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.848991 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.849156 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.849301 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.849445 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.849598 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.849598 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.849881 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.850033 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.850179 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.850322 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.850465 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.850609 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.850760 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.850906 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.851059 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.851205 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.851348 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.851505 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.851650 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.851794 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.851938 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.852081 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.852223 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.852377 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.852529 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.852757 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.852940 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.853087 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.853241 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.853465 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.853621 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.853773 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.853924 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.854069 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.854928 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.855093 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.855240 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.855394 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.855540 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.855695 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.855849 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.855996 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.856140 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.856293 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.856440 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.856584 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.856741 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.856961 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.857107 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.857260 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.857405 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.857551 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.857715 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.857861 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.858005 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.858148 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.858304 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.858458 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.858604 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.858757 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.858902 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.859045 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.859188 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.859338 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.859489 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.859653 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.859798 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.859943 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.860086 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.860229 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.860372 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.860524 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.860669 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.860941 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.861123 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.861301 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.861448 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.861627 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.861787 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.861933 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.862077 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.862269 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.862478 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.862628 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.862793 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.863009 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.863159 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.863307 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.863461 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.863645 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.863848 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.863997 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.864170 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.864318 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.864473 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.864627 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.864772 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.865175 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.865416 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.865645 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.865883 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.866094 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.866246 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.866921 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867018 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867100 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867186 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867274 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867362 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867450 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867518 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867596 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867683 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867769 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867855 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.867940 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868019 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868105 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868184 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868262 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868339 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868423 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868502 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868587 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868668 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868752 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868851 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868930 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.868998 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.869076 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.869146 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.869211 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.869276 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.869341 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.869406 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.869484 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.869558 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.869786 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.869873 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.870099 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.870176 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.870414 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.870492 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.870873 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.870973 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.871055 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.871209 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.871350 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.871493 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.871637 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.871783 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.871939 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.872039 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.872243 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.872330 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.872552 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.872639 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.872880 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.873006 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.873211 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.873299 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.873518 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.873604 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.873823 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.873917 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.874132 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.874219 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.874437 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.874531 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.874745 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.874839 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.875057 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.875178 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.875371 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.875470 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.875682 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.875779 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.875995 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.876090 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.876309 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.876398 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.876624 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.876714 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.876959 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.877058 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.877273 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.877359 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.877580 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.877667 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.877886 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.877982 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.878201 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.878294 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.878515 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.878602 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.878819 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.878917 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.879128 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.879227 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.879432 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.879519 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.879748 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.879856 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.880056 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.880166 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.880375 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.880495 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.880699 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.880864 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.881053 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.881154 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.881361 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.881448 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.881671 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.881759 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.881981 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.882078 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.882293 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.882380 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.882609 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.882697 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.882922 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.883024 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.883236 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.883323 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.883551 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.883638 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.883885 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.883996 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.884171 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.884259 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.884486 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.884573 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.884836 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.884930 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.885132 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.885219 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.885472 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.885570 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.885783 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.885877 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.886091 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.886178 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.886398 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.886485 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.886711 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.886798 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.887017 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.887102 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.887321 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.887416 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.887634 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.887745 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.887940 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.888064 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.888370 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.888479 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.888679 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.888771 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.889020 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.889108 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.889327 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.889422 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.889641 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.889718 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.889956 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.890054 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.890272 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.890372 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.890588 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.890675 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.890895 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.890984 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.891259 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.891353 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.891587 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.891678 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.891916 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.892003 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.892228 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.892315 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.892537 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.892625 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.892872 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.892982 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.893185 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.893280 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.893514 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.893611 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.893823 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.893937 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.894136 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.894261 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.894443 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.894534 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.894766 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.894853 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.895073 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.895170 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.895395 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.895499 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.895856 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.896160 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.896348 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.896440 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.896521 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.896607 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.896694 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.896857 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.896998 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.897179 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.897310 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.897494 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.897638 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.897822 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.897948 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.898151 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.898246 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.898480 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.898567 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.898791 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.898880 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.899111 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.899199 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.899423 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.899520 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.899751 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.899839 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.900067 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.900157 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.900378 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.900478 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.900693 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.900799 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.901553 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.901650 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.901881 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.901979 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.902189 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.902282 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.902515 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.902610 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.902826 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.902921 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.903133 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.903250 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.903443 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.903596 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.903744 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.903890 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.904082 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.904185 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.904436 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.904580 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.904725 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.904881 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.905051 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.905142 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.905389 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.905477 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.905701 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.905805 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.906010 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.906100 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.906338 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.906428 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.906646 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.906735 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.906963 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.907049 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.907273 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.907358 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.907584 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.907670 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.907886 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.907971 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.908195 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.908290 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.908499 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.908585 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.908818 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.908910 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.909131 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.909230 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.909448 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.909534 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.909752 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.909860 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.910057 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.910152 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.910361 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.910447 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.910682 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.910767 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.910989 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.911083 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.911293 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.911378 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.911599 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.911685 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.911905 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.911999 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.912212 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.912319 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.912517 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.912605 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.912869 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.912973 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.913191 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.913287 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.913524 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.913613 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.913840 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.913929 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.914167 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.914255 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.914497 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.914595 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.914807 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.914894 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.915127 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.915215 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.915449 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.915535 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.915754 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.915846 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.916062 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.916151 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.916374 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.916462 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.917250 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.917347 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.917577 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.917667 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.917896 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.917989 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.918206 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.918299 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.918514 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.918602 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.918819 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.918906 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.919137 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.919235 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.919467 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.919711 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.919799 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.920045 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.920149 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.920365 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.920455 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.920680 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.920767 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.921014 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.921111 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.921321 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.921427 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.921639 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.921727 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.921957 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.922044 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.922273 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.922361 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.922588 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.922675 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.922901 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.922996 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.923232 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.923318 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.923547 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.923635 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.923878 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.923978 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.924199 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.924288 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.924519 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.924617 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.924860 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.924965 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.925439 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.925533 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.925765 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.925851 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.926083 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.926179 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.926398 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.926491 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.926712 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.926800 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.927028 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.927118 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.927352 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.927438 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.927670 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.927758 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.927994 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.928227 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.928322 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.928556 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.928653 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.928901 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.929004 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.929218 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.929309 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.929532 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.929620 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.929855 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.929948 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.930170 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.930266 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.930481 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.930568 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.930796 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.930885 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.931106 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.931216 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.931418 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.931515 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.931744 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.931831 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.932067 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.932192 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.932438 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.932614 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.932802 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.932956 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.933124 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.933297 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.933441 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.933637 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.933746 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.933954 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.934053 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.934273 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.934418 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.934590 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.934741 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.934919 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.935052 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.935228 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.935375 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.935537 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.935699 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.935850 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.936020 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.936161 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.936339 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.936468 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.936658 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.936822 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.936999 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.937132 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.937323 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.937439 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.937642 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.937763 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.937952 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.938076 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.938268 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.938583 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.938678 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.938912 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.938999 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.939250 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.939338 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.939571 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.939664 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.939888 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.939977 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.940202 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.940291 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.940510 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.940596 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.940862 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.941057 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.941177 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.941376 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.941486 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.941714 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.941801 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.942045 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.942134 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.942372 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.942460 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.942694 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.942781 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.943004 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.943092 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.943315 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.943401 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.943622 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.943709 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.943926 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.944013 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.944230 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.944329 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.944538 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.944703 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.944852 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.944937 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.945176 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.945266 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.945483 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.945584 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.945787 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.945874 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.946090 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.946175 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.946398 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.946497 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.946706 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.946931 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.947051 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.947288 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.947391 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.947616 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.947719 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.948072 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.948166 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.948247 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.948326 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.948538 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.948632 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.948874 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.948976 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.949194 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.949301 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.949507 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.949594 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.949813 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.949908 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.950128 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.950222 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.950435 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.950532 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.950751 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.950839 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.951056 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.951151 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.951368 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.951457 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.951680 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.951765 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.951993 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.952089 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.952311 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.952406 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.952616 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.952712 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.952967 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.953194 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.953284 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.953537 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.953624 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.953860 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.953956 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.954173 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.954272 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.954479 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.954567 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.954783 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.954925 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.955090 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.955179 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.955395 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.955483 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.955706 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.955806 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.956013 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.956102 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.956324 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.956411 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.956628 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.956724 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.956958 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.957047 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.957262 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.957350 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.957574 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.957664 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.957880 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.958104 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.958198 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.958427 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.958536 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.958737 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.958824 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.959053 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.959141 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.959374 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.959470 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.959710 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.959803 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.960021 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.960113 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.960333 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.960476 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.960652 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.960745 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.961001 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.961101 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.961320 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.961534 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.961622 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.961872 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.961960 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.962194 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.962294 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.962539 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.962634 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.962870 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.962957 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.963180 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.963279 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.964024 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.964118 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.964335 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.964454 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.964660 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.964757 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.964999 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.965100 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.965315 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.965410 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.965628 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.965717 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.965940 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.966040 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.966251 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.966387 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.966564 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.966722 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.967052 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.967145 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.967364 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.967457 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.967677 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.967765 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.967985 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.968073 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.968299 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.968395 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.968641 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.968735 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.968990 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.969079 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.969310 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.969413 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.969631 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.969720 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.969950 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.970037 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.970264 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.970359 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.970578 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.970673 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.970889 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.970983 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.971202 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.971298 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.971516 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.971602 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.971841 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.971929 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.972157 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.972251 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.972465 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.972576 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.972775 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.972897 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.973125 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.973215 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.973481 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.973631 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.973768 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.973909 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.974117 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.974265 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.974390 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.974529 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.974662 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.974823 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.974977 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.975170 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.975311 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.975446 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.975582 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.975759 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.975905 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.976069 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.976220 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.976393 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.976547 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.976708 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.976923 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.977081 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.977213 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.977418 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.977529 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.977744 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.977835 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.978069 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.978158 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.978402 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.978490 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.978722 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.978813 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.979053 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.979168 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.979897 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.979986 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.980215 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.980316 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.980526 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.980671 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.980859 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.980967 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.981187 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.981275 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.981508 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.981595 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.981813 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.981912 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.982136 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.982223 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.982447 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.982534 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.982766 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.982863 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.983076 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.983163 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.983387 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.983473 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.983697 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.983785 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.984015 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.984117 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.984334 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.984430 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.984647 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.984743 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.984985 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.985074 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.985299 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.985401 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.985614 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.985703 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.985923 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.986010 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.986250 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.986337 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.986575 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.986664 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.986895 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.986983 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.987214 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.987353 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.987542 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.987629 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.987853 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.987947 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.988169 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.988272 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.988434 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:30:27.988522 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.988800 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.989117 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.989428 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.989759 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.990088 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.990398 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.990731 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.991047 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.991368 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.991685 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.992000 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.992336 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.992649 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.993065 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.993383 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.993694 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.994013 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.994334 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.994679 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.995017 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.995349 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.995677 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.996081 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.996342 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.996689 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.997044 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:30:27.997291 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:30:28.021698 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG oslo_db.sqlalchemy.engines [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:30:28.031471 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_db.sqlalchemy.engines [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:30:28.266248 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.context [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f5f8018-539f-4757-94b5-f5fec5deb6e6(cell1) {{(pid=87108) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 14:30:28.270423 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG oslo_concurrency.lockutils [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:30:28.272058 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG oslo_concurrency.lockutils [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:30:28.272900 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG oslo_concurrency.lockutils [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:30:28.274889 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG oslo_concurrency.lockutils [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:30:28.275688 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.context [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f5f8018-539f-4757-94b5-f5fec5deb6e6(cell1) {{(pid=87109) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 14:30:28.281039 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:30:28.282767 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:30:28.283608 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:30:28.285712 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:30:28.303845 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG oslo_db.sqlalchemy.engines [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:30:28.304727 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG oslo_db.sqlalchemy.engines [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:30:28.314601 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_db.sqlalchemy.engines [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:30:28.317730 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_db.sqlalchemy.engines [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:30:28.339686 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG oslo_db.sqlalchemy.engines [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:30:28.348579 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_db.sqlalchemy.engines [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:30:28.503994 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO keyring.backend [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Loading KWallet Dec 16 14:30:28.505430 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO keyring.backend [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Loading KWallet Dec 16 14:30:28.514484 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO keyring.backend [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Loading SecretService Dec 16 14:30:28.515789 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO keyring.backend [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Loading SecretService Dec 16 14:30:28.517771 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:30:28.517771 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: from cryptography.utils import int_from_bytes Dec 16 14:30:28.518026 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:30:28.518026 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: from cryptography.utils import int_from_bytes Dec 16 14:30:28.518733 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO keyring.backend [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Loading Windows Dec 16 14:30:28.519051 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:30:28.519051 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: from cryptography.utils import int_from_bytes Dec 16 14:30:28.519357 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:30:28.519357 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: from cryptography.utils import int_from_bytes Dec 16 14:30:28.520062 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO keyring.backend [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Loading Windows Dec 16 14:30:28.520522 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO keyring.backend [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Loading chainer Dec 16 14:30:28.521316 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO keyring.backend [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Loading macOS Dec 16 14:30:28.521893 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO keyring.backend [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Loading chainer Dec 16 14:30:28.522664 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO keyring.backend [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Loading macOS Dec 16 14:30:28.868493 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: WARNING keystonemiddleware.auth_token [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:30:28.872095 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: WARNING keystonemiddleware.auth_token [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:30:28.875677 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: WARNING keystonemiddleware.auth_token [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:30:28.878647 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: WARNING keystonemiddleware.auth_token [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:30:29.086298 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: WARNING keystonemiddleware.auth_token [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:30:29.091444 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: WARNING keystonemiddleware.auth_token [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:30:29.091557 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: WARNING keystonemiddleware.auth_token [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:30:29.096622 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: WARNING keystonemiddleware.auth_token [None req-334e1125-5927-4b91-a29e-8cd960ce4b44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:30:29.096733 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5648ab1d59c0 pid: 87108 (default app) Dec 16 14:30:29.098805 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:30:29.099907 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001652 Dec 16 14:30:29.100305 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Thu Dec 16 14:30:29 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:30:29.101895 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5648ab1d59c0 pid: 87109 (default app) Dec 16 14:31:49.171705 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:49.172717 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Dec 16 14:31:49.173169 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:31:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:49.763734 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-56159f8b-dea3-4de3-9e6a-474c60a6ca67 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:49.790528 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-56159f8b-dea3-4de3-9e6a-474c60a6ca67 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.609662 Dec 16 14:31:49.791088 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Thu Dec 16 14:31:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:31:51.937739 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:51.938744 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-9daf9cff-d2bf-406c-9192-095942371fcb None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Dec 16 14:31:51.939151 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:31:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:51.996956 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-dabc74e5-48ed-43e1-8b73-4adcd75bc509 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "vcpus": 1}} {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:52.014727 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:31:52.014727 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: warnings.warn(msg) Dec 16 14:31:52.041742 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-dabc74e5-48ed-43e1-8b73-4adcd75bc509 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.095593 Dec 16 14:31:52.042294 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Dec 16 14:31:51 2021] POST /compute/v2.1/flavors => generated 407 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:31:52.263416 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-80c14c03-4243-48f0-9294-565e16066eae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:52.265795 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:31:52.265795 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: warnings.warn(msg) Dec 16 14:31:52.420651 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-80c14c03-4243-48f0-9294-565e16066eae admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.370202 Dec 16 14:31:52.421522 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Thu Dec 16 14:31:52 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:31:54.563953 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-dabc74e5-48ed-43e1-8b73-4adcd75bc509 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:54.564999 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-dabc74e5-48ed-43e1-8b73-4adcd75bc509 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Dec 16 14:31:54.565414 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:31:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:54.671864 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-2e2142f9-aa29-4d17-84f1-bdae67a6415c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "swap": 0}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:54.690095 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:31:54.690095 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: warnings.warn(msg) Dec 16 14:31:54.717275 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-2e2142f9-aa29-4d17-84f1-bdae67a6415c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145294 Dec 16 14:31:54.717848 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Dec 16 14:31:54 2021] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:31:54.729422 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-b92f8de5-f0ab-49de-8e00-b03387241a62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:54.730890 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:31:54.730890 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: warnings.warn(msg) Dec 16 14:31:54.771365 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-b92f8de5-f0ab-49de-8e00-b03387241a62 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045433 Dec 16 14:31:54.772051 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Thu Dec 16 14:31:54 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:31:56.949229 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-2e2142f9-aa29-4d17-84f1-bdae67a6415c admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:56.950689 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-2e2142f9-aa29-4d17-84f1-bdae67a6415c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001910 Dec 16 14:31:56.951125 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:31:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:57.012272 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-6bfb8c43-40f0-47cf-8b49-fa57ce9c64b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:57.036289 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-6bfb8c43-40f0-47cf-8b49-fa57ce9c64b3 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077114 Dec 16 14:31:57.036853 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Dec 16 14:31:56 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:31:57.049041 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-10395cf1-d82c-4546-b435-01298130657c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:57.084307 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-10395cf1-d82c-4546-b435-01298130657c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039164 Dec 16 14:31:57.084917 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Thu Dec 16 14:31:57 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:31:59.258796 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-6bfb8c43-40f0-47cf-8b49-fa57ce9c64b3 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:31:59.259830 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-6bfb8c43-40f0-47cf-8b49-fa57ce9c64b3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Dec 16 14:31:59.260227 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:31:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:31:59.316259 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-552749e6-c59b-4a1e-ad31-45dd8a53d4ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:59.340056 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-552749e6-c59b-4a1e-ad31-45dd8a53d4ef admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073841 Dec 16 14:31:59.340595 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Dec 16 14:31:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:31:59.352808 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-2038d874-1fef-4c8e-862b-e17b4a9fbec7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:31:59.386958 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-2038d874-1fef-4c8e-862b-e17b4a9fbec7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038386 Dec 16 14:31:59.387512 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Thu Dec 16 14:31:59 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:32:01.531397 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-552749e6-c59b-4a1e-ad31-45dd8a53d4ef admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:32:01.532396 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-552749e6-c59b-4a1e-ad31-45dd8a53d4ef admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Dec 16 14:32:01.532810 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:32:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:32:01.591174 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-08517c0c-4f53-41a6-9590-25234dc457ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:01.616183 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-08517c0c-4f53-41a6-9590-25234dc457ad admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076344 Dec 16 14:32:01.616744 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Dec 16 14:32:01 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:32:01.628421 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-103e8821-3d4b-43e3-bc7c-995cf4a437ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:01.664868 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-103e8821-3d4b-43e3-bc7c-995cf4a437ed admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039932 Dec 16 14:32:01.665437 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Thu Dec 16 14:32:01 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:32:03.799331 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-08517c0c-4f53-41a6-9590-25234dc457ad admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:32:03.800340 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-08517c0c-4f53-41a6-9590-25234dc457ad admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Dec 16 14:32:03.800742 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:32:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:32:03.863398 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-cf35ee09-a0b0-4775-988e-e85964e9d502 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:32:03.887915 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-cf35ee09-a0b0-4775-988e-e85964e9d502 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080365 Dec 16 14:32:03.888479 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Thu Dec 16 14:32:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:32:06.060248 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-08517c0c-4f53-41a6-9590-25234dc457ad admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:32:06.061297 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-08517c0c-4f53-41a6-9590-25234dc457ad admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Dec 16 14:32:06.061697 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:32:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:32:06.122039 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-a9f91d85-0131-4235-a059-37260e8dc0f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:06.146839 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-a9f91d85-0131-4235-a059-37260e8dc0f7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078387 Dec 16 14:32:06.147291 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Dec 16 14:32:06 2021] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:32:06.158866 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-80f1845d-4d0e-46e5-b83e-23abcd024702 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:06.196240 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-80f1845d-4d0e-46e5-b83e-23abcd024702 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040982 Dec 16 14:32:06.196837 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Thu Dec 16 14:32:06 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:32:08.386137 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-a9f91d85-0131-4235-a059-37260e8dc0f7 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:32:08.387132 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-a9f91d85-0131-4235-a059-37260e8dc0f7 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Dec 16 14:32:08.387528 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:32:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:32:08.445838 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-9968dfc8-841c-40c1-bda0-fb5dd873ce5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small"}} {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:08.470453 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-9968dfc8-841c-40c1-bda0-fb5dd873ce5a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076556 Dec 16 14:32:08.471022 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Dec 16 14:32:08 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:32:08.482814 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-e8cc5643-8817-4550-a021-62809e906163 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:08.517730 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-e8cc5643-8817-4550-a021-62809e906163 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038448 Dec 16 14:32:08.518305 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Thu Dec 16 14:32:08 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:32:10.627853 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-9968dfc8-841c-40c1-bda0-fb5dd873ce5a admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:32:10.628870 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-9968dfc8-841c-40c1-bda0-fb5dd873ce5a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Dec 16 14:32:10.629267 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:32:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:32:10.688292 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-e9a2d7a9-4df1-484a-afbb-3d736f6fb8bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "id": "3"}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:10.712136 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-e9a2d7a9-4df1-484a-afbb-3d736f6fb8bd admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076725 Dec 16 14:32:10.712663 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Dec 16 14:32:10 2021] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:32:10.723898 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-632a2e8f-3933-4555-a2eb-d3e0946dccb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:10.760461 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-632a2e8f-3933-4555-a2eb-d3e0946dccb2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040075 Dec 16 14:32:10.761061 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Thu Dec 16 14:32:10 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:32:12.916095 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-e9a2d7a9-4df1-484a-afbb-3d736f6fb8bd admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:32:12.917149 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-e9a2d7a9-4df1-484a-afbb-3d736f6fb8bd admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Dec 16 14:32:12.917552 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:32:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:32:12.975879 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-7243d3dc-2fc8-43cf-9656-f1549fa38b56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80}} {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:13.006660 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-7243d3dc-2fc8-43cf-9656-f1549fa38b56 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082706 Dec 16 14:32:13.007203 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Dec 16 14:32:12 2021] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:32:13.018862 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-4d404419-d444-49ea-b82b-e1e4d3c48d79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:13.059055 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-4d404419-d444-49ea-b82b-e1e4d3c48d79 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043774 Dec 16 14:32:13.059647 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Thu Dec 16 14:32:13 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:32:15.242897 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-7243d3dc-2fc8-43cf-9656-f1549fa38b56 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:32:15.243881 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-7243d3dc-2fc8-43cf-9656-f1549fa38b56 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Dec 16 14:32:15.244283 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:32:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:32:15.303022 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-ef94c243-e275-4ca2-beb3-84f2bb5babfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "name": "m1.xlarge", "id": "5", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:15.326430 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-ef94c243-e275-4ca2-beb3-84f2bb5babfc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075739 Dec 16 14:32:15.326974 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Thu Dec 16 14:32:15 2021] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:32:15.338422 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-961bf03f-08f3-45b6-b295-c6779c6f88d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:32:15.374178 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-961bf03f-08f3-45b6-b295-c6779c6f88d2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039268 Dec 16 14:32:15.374759 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Thu Dec 16 14:32:15 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:33:21.953153 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-ef94c243-e275-4ca2-beb3-84f2bb5babfc admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:21.954151 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-ef94c243-e275-4ca2-beb3-84f2bb5babfc admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Dec 16 14:33:21.954549 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Thu Dec 16 14:33:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:33:22.009513 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-11ed0707-6c16-4f0a-8236-f35d001b223e admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:22.032905 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-11ed0707-6c16-4f0a-8236-f35d001b223e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071679 Dec 16 14:33:22.034068 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Thu Dec 16 14:33:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:33:23.408525 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-ef94c243-e275-4ca2-beb3-84f2bb5babfc admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:23.409547 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-ef94c243-e275-4ca2-beb3-84f2bb5babfc admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001938 Dec 16 14:33:23.409945 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:33:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:33:23.598683 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-edc54d94-6485-4e76-89f1-ef51796a62f4 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:23.611333 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.wsgi [None req-edc54d94-6485-4e76-89f1-ef51796a62f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 16 14:33:23.611899 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-edc54d94-6485-4e76-89f1-ef51796a62f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:33:23.612678 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-edc54d94-6485-4e76-89f1-ef51796a62f4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.065727 Dec 16 14:33:23.613284 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Dec 16 14:33:23 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:23.622575 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-21438bc8-13b4-4577-bf15-55c8a0aa7505 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:23.642657 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-21438bc8-13b4-4577-bf15-55c8a0aa7505 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023069 Dec 16 14:33:23.643188 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Dec 16 14:33:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:33:23.654651 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-fe9fa2fd-5c90-43a8-86ea-dd0b82505bca admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:23.676109 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-fe9fa2fd-5c90-43a8-86ea-dd0b82505bca admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026114 Dec 16 14:33:23.676657 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Dec 16 14:33:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:33:23.686349 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-cf37ba0b-edd1-4900-953c-0156f3b38a17 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:23.698921 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.wsgi [None req-cf37ba0b-edd1-4900-953c-0156f3b38a17 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 16 14:33:23.699500 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-cf37ba0b-edd1-4900-953c-0156f3b38a17 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:33:23.700296 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-cf37ba0b-edd1-4900-953c-0156f3b38a17 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.017598 Dec 16 14:33:23.700857 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Dec 16 14:33:23 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:25.029627 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-fe9fa2fd-5c90-43a8-86ea-dd0b82505bca admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:25.030620 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-fe9fa2fd-5c90-43a8-86ea-dd0b82505bca admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Dec 16 14:33:25.031012 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:33:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:33:25.217919 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-948c51dc-3737-4f6e-a786-205fb97ead81 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:25.230107 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.wsgi [None req-948c51dc-3737-4f6e-a786-205fb97ead81 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 16 14:33:25.230684 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-948c51dc-3737-4f6e-a786-205fb97ead81 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:33:25.231480 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-948c51dc-3737-4f6e-a786-205fb97ead81 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.063672 Dec 16 14:33:25.232014 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Dec 16 14:33:25 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:25.242178 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-00a09f89-538e-4e5e-b7e3-c2debf7876e9 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:25.262484 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-00a09f89-538e-4e5e-b7e3-c2debf7876e9 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023781 Dec 16 14:33:25.263033 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Dec 16 14:33:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:33:25.272654 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-98d401cc-e750-4605-8f9e-de8d8b98ea0e admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:25.292340 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-98d401cc-e750-4605-8f9e-de8d8b98ea0e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022912 Dec 16 14:33:25.292897 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Dec 16 14:33:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:33:25.302863 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-26cf6e04-1db0-4807-873d-a344584e3567 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:25.315388 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.wsgi [None req-26cf6e04-1db0-4807-873d-a344584e3567 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 16 14:33:25.315946 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-26cf6e04-1db0-4807-873d-a344584e3567 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:33:25.316720 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-26cf6e04-1db0-4807-873d-a344584e3567 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017482 Dec 16 14:33:25.317259 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Thu Dec 16 14:33:25 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:26.635673 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-98d401cc-e750-4605-8f9e-de8d8b98ea0e admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:26.636671 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-98d401cc-e750-4605-8f9e-de8d8b98ea0e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Dec 16 14:33:26.637110 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:33:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:33:26.827866 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-7019ff88-8bf5-47e5-87ea-02beeb68f0bb admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:26.840325 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.wsgi [None req-7019ff88-8bf5-47e5-87ea-02beeb68f0bb admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 16 14:33:26.840967 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-7019ff88-8bf5-47e5-87ea-02beeb68f0bb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:33:26.841685 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-7019ff88-8bf5-47e5-87ea-02beeb68f0bb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.064367 Dec 16 14:33:26.842187 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Dec 16 14:33:26 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:33:26.852225 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-ce6cb243-8496-46fd-a99e-c528ca05c1b5 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:26.871887 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-ce6cb243-8496-46fd-a99e-c528ca05c1b5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023083 Dec 16 14:33:26.872386 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Dec 16 14:33:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:33:26.882484 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:26.902964 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024040 Dec 16 14:33:26.903764 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Thu Dec 16 14:33:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:33:26.913273 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-d5fe9567-0e1a-4bbc-be32-d4905739b763 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:26.925401 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.wsgi [None req-d5fe9567-0e1a-4bbc-be32-d4905739b763 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 16 14:33:26.925957 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-d5fe9567-0e1a-4bbc-be32-d4905739b763 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:33:26.926716 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-d5fe9567-0e1a-4bbc-be32-d4905739b763 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017072 Dec 16 14:33:26.927195 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Dec 16 14:33:26 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 16 14:33:28.239812 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:28.240820 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Dec 16 14:33:28.241224 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:33:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:33:28.429914 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-5add7478-460e-4835-aa40-e0d54fea20eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:33:28.455771 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-5add7478-460e-4835-aa40-e0d54fea20eb admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.075116 Dec 16 14:33:28.456300 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Dec 16 14:33:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:33:29.783276 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:29.784295 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 Dec 16 14:33:29.784717 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:33:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:33:29.969754 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-c87a06be-8dcd-4174-bea6-87bd28158b36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:33:29.994122 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-c87a06be-8dcd-4174-bea6-87bd28158b36 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.074171 Dec 16 14:33:29.994577 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Dec 16 14:33:29 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:33:31.318384 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:31.319378 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Dec 16 14:33:31.319770 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:33:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:33:31.505168 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-d211e478-e2c9-4ebd-9c9e-8300fd8a0d75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:33:31.529721 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-d211e478-e2c9-4ebd-9c9e-8300fd8a0d75 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.074756 Dec 16 14:33:31.530186 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Dec 16 14:33:31 2021] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:33:32.832668 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:32.833789 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Dec 16 14:33:32.834281 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:33:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:33:33.022567 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-886e8e87-1de7-4c0e-89b1-69d59754cffc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:33:33.045587 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-886e8e87-1de7-4c0e-89b1-69d59754cffc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.073750 Dec 16 14:33:33.046042 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Thu Dec 16 14:33:32 2021] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:33:34.375624 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:34.377187 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Dec 16 14:33:34.377618 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:33:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:33:34.589524 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-7a6703e0-8ec9-417d-9a92-bc7ccc926d93 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:33:34.614090 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-7a6703e0-8ec9-417d-9a92-bc7ccc926d93 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075707 Dec 16 14:33:34.614847 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Thu Dec 16 14:33:34 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:34:18.703111 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:34:18.704159 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-e6513800-4639-43c6-98fa-571f5ed80335 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Dec 16 14:34:18.704563 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 31/63] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:34:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:34:18.900042 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-bdcf280b-b828-4c0e-9e7e-484e334b7b30 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:34:18.924710 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-bdcf280b-b828-4c0e-9e7e-484e334b7b30 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075926 Dec 16 14:34:18.925272 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1202 bytes} [Thu Dec 16 14:34:18 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:35:38.782516 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-761cd5dd-f859-46f8-8181-354f346f60c4 tempest-verify_tempest_config-2039836648 tempest-verify_tempest_config-2039836648-project] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:35:38.784470 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-761cd5dd-f859-46f8-8181-354f346f60c4 tempest-verify_tempest_config-2039836648 tempest-verify_tempest_config-2039836648-project] 10.222.0.64 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.117526 Dec 16 14:35:38.785050 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 32/65] 10.222.0.64 () {58 vars in 1133 bytes} [Thu Dec 16 14:35:38 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:37:11.085861 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-bdcf280b-b828-4c0e-9e7e-484e334b7b30 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:11.086859 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-bdcf280b-b828-4c0e-9e7e-484e334b7b30 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Dec 16 14:37:11.087259 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 34/66] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:37:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:11.347318 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-70c6b097-5a4a-47e0-aa29-e93913100e92 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:11.348479 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:37:11.348479 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: warnings.warn(msg) Dec 16 14:37:11.350062 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-70c6b097-5a4a-47e0-aa29-e93913100e92 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:11.350497 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-70c6b097-5a4a-47e0-aa29-e93913100e92 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:11.351317 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-70c6b097-5a4a-47e0-aa29-e93913100e92 admin admin] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:11.351740 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-70c6b097-5a4a-47e0-aa29-e93913100e92 admin admin] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:11.384148 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-70c6b097-5a4a-47e0-aa29-e93913100e92 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.157355 Dec 16 14:37:11.384723 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Dec 16 14:37:11 2021] GET /compute/v2.1/os-services => generated 791 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:37:12.719567 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-bdcf280b-b828-4c0e-9e7e-484e334b7b30 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:12.720566 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-bdcf280b-b828-4c0e-9e7e-484e334b7b30 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Dec 16 14:37:12.720988 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 35/68] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:37:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:12.911475 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-bcfe65b3-1842-4cdc-99f1-f4fbc6cc0746 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:12.912630 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:37:12.912630 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: warnings.warn(msg) Dec 16 14:37:12.914191 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-bcfe65b3-1842-4cdc-99f1-f4fbc6cc0746 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:12.914627 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-bcfe65b3-1842-4cdc-99f1-f4fbc6cc0746 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:12.915410 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-bcfe65b3-1842-4cdc-99f1-f4fbc6cc0746 admin admin] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:12.915832 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-bcfe65b3-1842-4cdc-99f1-f4fbc6cc0746 admin admin] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:12.941013 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-bcfe65b3-1842-4cdc-99f1-f4fbc6cc0746 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.082010 Dec 16 14:37:12.942115 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 34/69] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Dec 16 14:37:12 2021] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:37:24.725309 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-bdcf280b-b828-4c0e-9e7e-484e334b7b30 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:24.726354 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-bdcf280b-b828-4c0e-9e7e-484e334b7b30 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Dec 16 14:37:24.726745 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 36/70] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:37:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:24.919349 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-2fe07e38-d40c-4542-9102-46d5a1bcf33e admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:24.920959 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:37:24.920959 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: warnings.warn(msg) Dec 16 14:37:24.922033 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-2fe07e38-d40c-4542-9102-46d5a1bcf33e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:24.922476 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-2fe07e38-d40c-4542-9102-46d5a1bcf33e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:24.923262 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-2fe07e38-d40c-4542-9102-46d5a1bcf33e admin admin] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:24.923694 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-2fe07e38-d40c-4542-9102-46d5a1bcf33e admin admin] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:24.952347 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-2fe07e38-d40c-4542-9102-46d5a1bcf33e admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.084926 Dec 16 14:37:24.952983 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 35/71] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Dec 16 14:37:24 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:37:26.290673 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: DEBUG nova.api.openstack.wsgi [None req-bdcf280b-b828-4c0e-9e7e-484e334b7b30 admin admin] Calling method '>' {{(pid=87108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:26.291680 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: INFO nova.api.openstack.requestlog [None req-bdcf280b-b828-4c0e-9e7e-484e334b7b30 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Dec 16 14:37:26.292081 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: [pid: 87108|app: 0|req: 37/72] 10.222.0.64 () {56 vars in 1074 bytes} [Thu Dec 16 14:37:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:37:26.486332 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG nova.api.openstack.wsgi [None req-6032f038-5050-4452-98e2-3ff1ccd13b80 admin admin] Calling method '>' {{(pid=87109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:37:26.488960 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:37:26.488960 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: warnings.warn(msg) Dec 16 14:37:26.491674 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-6032f038-5050-4452-98e2-3ff1ccd13b80 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:26.492144 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-6032f038-5050-4452-98e2-3ff1ccd13b80 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:26.493260 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-6032f038-5050-4452-98e2-3ff1ccd13b80 admin admin] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:37:26.493695 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: DEBUG oslo_concurrency.lockutils [None req-6032f038-5050-4452-98e2-3ff1ccd13b80 admin admin] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:37:26.519388 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: INFO nova.api.openstack.requestlog [None req-6032f038-5050-4452-98e2-3ff1ccd13b80 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.088074 Dec 16 14:37:26.519963 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: [pid: 87109|app: 0|req: 36/73] 10.222.0.64 () {60 vars in 1193 bytes} [Thu Dec 16 14:37:26 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:38:22.454665 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: Thu Dec 16 14:38:22 2021 - graceful shutdown triggered... Dec 16 14:38:22.455209 dv-cinder-821892-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 16 14:38:22.455723 dv-cinder-821892-3-iscsi devstack@n-api.service[87108]: Gracefully killing worker 1 (pid: 87108)... Dec 16 14:38:22.456110 dv-cinder-821892-3-iscsi devstack@n-api.service[87109]: Gracefully killing worker 2 (pid: 87109)... Dec 16 14:38:23.456341 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: worker 1 buried after 1 seconds Dec 16 14:38:23.456341 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: worker 2 buried after 1 seconds Dec 16 14:38:23.456341 dv-cinder-821892-3-iscsi devstack@n-api.service[87107]: goodbye to uWSGI. Dec 16 14:38:23.457932 dv-cinder-821892-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 16 14:38:23.458510 dv-cinder-821892-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 16 14:38:23.461319 dv-cinder-821892-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 16 14:38:23.470884 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 16 14:38:23 2021] *** Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: nodename: dv-cinder-821892-3-iscsi Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: machine: x86_64 Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: clock source: unix Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: pcre jit disabled Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: detected number of CPU cores: 4 Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: current working directory: / Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: detected binary path: /usr/bin/uwsgi-core Dec 16 14:38:23.472908 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: your processes number limit is 47680 Dec 16 14:38:23.473744 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: your memory page size is 4096 bytes Dec 16 14:38:23.473744 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: detected max file descriptor number: 2048 Dec 16 14:38:23.473744 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: lock engine: pthread robust mutexes Dec 16 14:38:23.473744 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: thunder lock: enabled Dec 16 14:38:23.473744 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 16 14:38:23.473744 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 16 14:38:23.516555 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: Python main interpreter initialized at 0x5586748799c0 Dec 16 14:38:23.516555 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: python threads support enabled Dec 16 14:38:23.516555 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: your server socket listen backlog is limited to 100 connections Dec 16 14:38:23.516555 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: your mercy for graceful operations on workers is 90 seconds Dec 16 14:38:23.517226 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 14:38:23.517226 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: *** Operational MODE: preforking *** Dec 16 14:38:23.517492 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: *** uWSGI is running in multiple interpreter mode *** Dec 16 14:38:23.517492 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: spawned uWSGI master process (pid: 101895) Dec 16 14:38:23.517563 dv-cinder-821892-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 16 14:38:23.518674 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: spawned uWSGI worker 1 (pid: 101914, cores: 1) Dec 16 14:38:23.518674 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: spawned uWSGI worker 2 (pid: 101915, cores: 1) Dec 16 14:38:23.518674 dv-cinder-821892-3-iscsi devstack@n-api.service[101895]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 14:38:27.560850 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:38:27.561606 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:38:27.561606 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:38:27.561932 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:38:27.562244 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:38:27.563140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.563474 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.563798 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.564122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.564473 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.564761 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.568652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.568652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.568652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.568652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.568652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.568652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821892-3-iscsi {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.568652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.568652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.569360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.569360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.569360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.569360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.569360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.569360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.571651 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.571651 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.571651 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.571651 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.571651 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.571651 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.572236 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.572236 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.572483 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.572942 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.573251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821892-3-iscsi {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.573505 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.573847 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.574231 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.574789 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.575153 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.575447 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.575804 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.576190 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.576572 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.576894 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.577277 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.577613 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.577973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.578281 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.578590 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.578907 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.579231 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.579542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.579852 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.580104 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.580414 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.580740 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.581091 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.581418 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.581673 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.581926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.582247 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.582570 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.582878 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.583190 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.583502 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.583808 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.584116 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.584423 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.584729 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.585058 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.585381 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.585700 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.586026 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.586333 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.586655 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.587058 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.587313 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.587621 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.587966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.588286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.588597 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.588943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.589266 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.589574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.589885 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.590192 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.590516 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.590842 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.591150 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.591403 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.591704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.592008 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.592330 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.592637 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.592966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.593278 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.593616 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.593920 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.594227 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.594535 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.594840 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.595148 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.595463 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.595759 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.596065 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.596373 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.596697 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.597044 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.597352 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.597658 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.597966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.598270 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.598591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.598898 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.599204 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.599525 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.608739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.609815 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.609815 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.609815 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.609815 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.609815 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.609815 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.609815 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.609815 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.610351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.610351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.610351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.610351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.610351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.610351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.610351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.610351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.610868 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.610868 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.610868 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.611561 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.611561 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.611879 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.612033 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.612363 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.612688 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.613033 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.613358 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.613678 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.614005 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.614352 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.614663 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.614976 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.615384 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.615670 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.615990 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.616314 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.616622 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.617406 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.617406 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.617750 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.617920 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.618204 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.618512 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.618828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.619169 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.619495 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.619817 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.620126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.620436 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.620743 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.621084 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.621422 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.621717 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.622049 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.622500 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.622675 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.622989 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.623320 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.623624 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.623950 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.624266 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.625328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.625561 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.625786 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.626105 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.626412 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.626739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.627048 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.627358 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.627680 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.627999 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.628312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.628627 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.628979 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.629299 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.629610 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.630013 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.630285 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.630595 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.630923 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.631249 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.631571 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.631882 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.632195 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.632508 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.632835 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.633168 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.633460 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.633773 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.634088 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.634415 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.634909 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.635082 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.635432 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.635835 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.636152 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.636467 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.636918 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.637193 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.637630 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.638037 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.638344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.638685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.638959 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.639318 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.639704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.640022 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.640389 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.640728 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.641138 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.641457 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.641770 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.642091 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.642423 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.642759 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.643080 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.643419 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.643727 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.644052 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.644365 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.644686 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.645017 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.645328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.645763 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.645943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.646272 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.646589 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.646896 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.647237 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.647537 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.647837 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.648167 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.648455 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.648840 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.649116 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.649444 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.649770 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.650079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.650389 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.650719 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.651036 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.651353 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.651654 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.651961 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.652302 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.652914 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.653211 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.653555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.653854 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.654176 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.654493 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.654828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.655115 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.655446 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.656040 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.656255 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.656432 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.656875 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.657162 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.657356 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.657663 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.657979 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.658299 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.658605 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.658979 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.659226 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.659539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.660129 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.660472 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.660815 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.661136 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.661459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.661776 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.662114 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.662445 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.662766 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.663077 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.663433 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.663716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.663995 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.664318 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.664625 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.664990 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.665264 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.665582 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.665893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.666491 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.666491 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.667453 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.667453 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.667453 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.667919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.668125 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.668298 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.668615 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.668944 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.669255 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.669559 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.669929 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.671966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.671966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.671966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.671966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.672970 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.672970 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.672970 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.672970 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.674307 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.674307 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.674307 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.674307 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.675554 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.675554 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.675554 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.675554 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.676816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.676816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.676816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.676816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.678096 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.678096 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.678096 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.678096 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.678096 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.679548 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.679548 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.679548 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.679548 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.680471 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.680471 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.680471 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.680471 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.681546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.681546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.681546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.682282 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.682282 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.682282 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.682982 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.682982 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.683452 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.683452 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.684263 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.684263 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.684996 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.684996 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.684996 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.685840 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.685840 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.686310 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.686310 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.686926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.686926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.687919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.688459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.688459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.689105 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.689105 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.689776 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.689776 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.690321 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.690321 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.690790 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.690790 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.691252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.691496 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.691778 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.692008 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.692311 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.692636 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.692968 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.693299 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.693837 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.694110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.694645 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.694645 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.695260 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.695260 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.695893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.695893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.696337 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.696337 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.696876 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.697508 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.697508 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.698028 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.698028 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.698911 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.698911 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.698911 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.699963 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.699963 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.699963 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.700937 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.700937 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.700937 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.701658 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.701658 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.701658 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.702350 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.702350 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.702817 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.703044 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.703273 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.703585 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.703897 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.704210 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.704817 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.705085 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.705498 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.705498 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.706115 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.706115 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.706634 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.706874 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.707135 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.707774 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.707774 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.708236 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.708470 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.708923 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.709497 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.709497 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.709903 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.710225 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.710472 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.710841 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.711094 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.711337 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.711588 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.711891 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.712199 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.712529 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.712896 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.713219 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.713548 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.713978 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.714308 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.714605 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.715169 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.715433 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.715886 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.715886 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.716529 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.716529 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.717037 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.717289 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.717560 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.718152 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.718152 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.718640 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.718640 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.719111 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.719383 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.719946 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.719946 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.720396 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.720560 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.720883 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.721064 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.721392 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.721706 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.722012 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.722304 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.722614 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.722980 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.723272 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.723602 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.723939 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.724276 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.724590 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.725048 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.725331 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.725580 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.725902 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.726311 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.726534 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.726845 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.727157 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.727458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.727769 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.728244 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.728408 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.728673 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.729005 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.729312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.729685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.730047 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.730252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.730563 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.730868 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.731175 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.731576 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.731954 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.732263 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.732605 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.732966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.733391 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.733627 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.734500 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.734872 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.735295 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.735635 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.735994 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.736273 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.736593 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.736980 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.737278 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.737564 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.737933 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.738291 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.738566 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.739079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.739412 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.739804 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.740242 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.740242 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.740765 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.740998 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.741315 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.741733 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.741943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.742257 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.742586 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.742913 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.743245 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.743591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.743912 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.744229 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.744547 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.744893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.745295 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.745600 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.745890 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.746220 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.746599 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.746841 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.747164 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.747482 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.747795 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.748119 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.748459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.748764 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.749083 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.749400 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.750584 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.750793 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.751053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.751395 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.752834 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.752834 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.752834 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.752834 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.753169 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.753499 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.753825 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.754147 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.754468 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.754919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.755115 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.755423 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.755738 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.756050 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.756357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.756685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.757555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.758018 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.758419 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.758810 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.759459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.759847 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.760252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.760708 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.761090 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.761484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.761863 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.762261 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.762640 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.763018 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.763421 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.763805 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.764239 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.764551 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.765051 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.765486 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.765781 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.766163 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.766538 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.766936 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.767731 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.768011 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.768352 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.768710 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.769112 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.769490 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.769870 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.770248 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.770654 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.771032 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.771425 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.771788 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.772176 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.772554 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.772965 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.773344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.773982 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.774368 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.774757 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.775165 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.775709 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.776075 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.776536 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.776859 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.777329 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.778206 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.778929 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.779439 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.779896 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.780361 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.780960 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.781377 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.781946 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.782617 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.783014 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.783414 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.783806 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.784263 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.784582 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.785299 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.785462 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.785770 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.786156 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.786542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.786929 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.787336 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.787805 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.788226 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.788643 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.789089 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.789369 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.789756 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.790141 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.790523 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.790906 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.791317 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.791698 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.792093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.792496 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.793026 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.793413 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.793809 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.794204 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.794589 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.795066 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.795620 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.795806 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.796203 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.797364 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.797528 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.797917 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.798246 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.798662 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.799128 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.799456 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.799849 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.800251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.800641 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.801046 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.801490 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.801800 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.802186 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.802578 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.802981 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.803372 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.803755 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.804153 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.804532 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.804948 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.805326 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.805803 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.806099 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.806487 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.806892 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.807277 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.807672 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.808070 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.808466 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.808968 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.809704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.810001 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.810235 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.813459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.813459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.813459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.813459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.813459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.813459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.813459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.813459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.814490 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.814490 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.814832 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.815245 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.815678 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.816321 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.816688 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.817102 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.817513 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.817899 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.818302 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.818688 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.819078 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.819465 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.819857 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.820262 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.820663 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.821109 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.821513 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.821937 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.822332 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.823405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.823405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:27.823405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:38:27.858027 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_db.sqlalchemy.engines [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:38:27.976424 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:38:27.977045 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 14:38:27.977190 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:38:27.977558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 14:38:27.977816 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 14:38:27.978210 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.978541 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.978864 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.979187 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.979522 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.979837 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.980161 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.980488 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.980900 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.981109 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.981422 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.981752 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821892-3-iscsi {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.982077 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.982388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.982703 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.983025 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.983428 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.983652 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.983996 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.985268 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.985581 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.985892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.986207 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.986548 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.986868 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.987180 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.987596 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.987934 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.988334 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.988821 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.989073 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821892-3-iscsi {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.990038 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.990038 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.990038 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.990445 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.990736 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.991048 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.991373 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.991702 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.992018 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.992352 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.992677 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.995278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.995278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.995278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.995278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.995278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.995278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.995278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.995278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.996221 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.996221 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.996221 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.996542 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.996659 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.996865 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.997123 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.997451 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.997780 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.998081 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.998389 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.998728 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.999006 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.999323 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:27.999667 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.000019 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.000290 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.000618 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.000964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.001289 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.001599 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.001920 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.002332 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.002586 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.002894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.003241 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.003562 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.003871 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.004192 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.004515 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.004845 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.005159 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.005466 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.005788 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.006114 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.006421 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.006674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.006977 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.007284 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.007604 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.007906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.008210 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.008514 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.008872 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.009152 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.009461 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.009766 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.010647 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.010647 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.010647 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.011396 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.011396 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.011696 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.011860 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.012171 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.012476 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.012897 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.013107 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.013412 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.013733 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.014039 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.014345 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.014666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.014975 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.015361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.015635 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.015943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.016248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.016568 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.016894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.017204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.017527 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.017838 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.018150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.018456 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.018765 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.019073 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.019381 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.019689 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.019997 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.020300 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.020628 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.020977 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.021293 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.021600 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.021907 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.022229 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 14:38:28.022571 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.022908 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.023256 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.023573 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.023910 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.024246 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.024572 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.024911 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.025720 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.025720 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.026027 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.026172 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.026471 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.026791 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.027111 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.027507 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.028050 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.028334 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.028644 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.029003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.029327 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.029658 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.029984 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.030301 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.030646 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.031542 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.031862 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.032222 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.032499 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.032849 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.033252 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.033576 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.033893 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.034219 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.034535 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.034982 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.035402 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.035729 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.036054 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.036458 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.036795 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.037129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.037450 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.037770 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.038093 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.038486 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.038738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.039066 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.039379 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.039696 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.040012 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.040322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.040639 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.041001 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.041314 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.041645 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.041961 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.042270 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.042595 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.042906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.043215 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.043533 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.043850 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.044164 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.044480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.045151 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.045151 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.045478 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.045773 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.046105 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.046455 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.047369 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.047703 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.048024 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.048334 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.048814 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.048994 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.049292 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.049601 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.049915 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.050226 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.050539 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.050840 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.051149 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.051456 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.051785 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.052099 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.052408 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.052718 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.053055 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.053405 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.053715 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.054057 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.054376 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.054701 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.055331 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.055331 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.055641 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.055933 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.056248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.056576 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.056919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.057237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.057546 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.057860 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.058185 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.058522 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.058963 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.059140 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.059465 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.059780 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.060093 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.060408 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.060715 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.061054 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.061370 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.061689 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.062005 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.062350 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.062659 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.062976 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.063313 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.063640 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.064056 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.064229 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.064534 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.064866 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.065344 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.065621 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.065808 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.066117 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.066444 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.066761 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.067066 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.067374 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.067678 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.068023 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.068339 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.068648 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.069071 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.069322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.069640 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.069957 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.070272 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.070586 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.070920 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.071236 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.071577 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.071892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.072205 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.072517 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.072879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.073181 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.073497 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.073810 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.074192 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.074427 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.074740 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.075062 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.075712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.076008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.076325 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.076650 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.076998 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.077321 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.077655 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.078024 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.078337 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.078646 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.078961 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.079365 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.079566 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.079883 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.080189 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.080593 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.080846 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.081148 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.081456 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.081766 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.082074 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.082382 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.082700 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.083005 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.083341 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.083626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.083954 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.084359 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.084582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.084904 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.085211 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.085684 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.085973 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.086198 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.086532 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.086876 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.087356 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.087521 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.087807 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.088117 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.088443 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.088726 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.089065 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.089485 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.089679 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.090003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.090318 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.090726 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.090948 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.091255 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.091572 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.091880 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.092188 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.092497 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.092830 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.093150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.093987 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.094316 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.094632 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.094946 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.095259 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.095823 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.096013 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.096289 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.096490 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.096833 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.097147 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.097466 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.097769 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.098079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.098385 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.098749 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.099003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.099317 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.099734 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.099925 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.100233 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.100559 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.100898 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.101208 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.101524 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.102025 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.102192 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.102473 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.102837 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.103149 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.103468 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.103792 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.104110 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.104426 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.104744 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.105079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.105396 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.105973 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.106144 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.106309 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.106609 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.106934 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.107247 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.107558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.107722 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.context [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f5f8018-539f-4757-94b5-f5fec5deb6e6(cell1) {{(pid=101914) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 14:38:28.107883 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.108198 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.108527 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.108926 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.109951 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.110124 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.110369 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.110682 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.110992 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.111317 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.111616 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.111969 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.112234 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.112547 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.112711 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:28.112903 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.113201 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.113491 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.113799 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.114129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.114325 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:28.114492 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.114749 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.115051 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.115328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:28.115496 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.115644 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.116116 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.116388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.116704 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.117367 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.117585 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:28.117746 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.117746 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.118215 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.118360 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.118563 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.118873 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.119305 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.119624 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.120157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.120335 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.120546 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.120882 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.121199 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.121531 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.121843 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.122152 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.122462 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.122790 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.123101 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.123431 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.124048 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.124233 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.124695 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.125107 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.125301 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.125607 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.125938 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.126446 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.126615 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.126914 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.127204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.127522 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.127855 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.128183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.128499 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.129003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.129200 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.129455 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.129784 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.130644 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.130644 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.131105 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.131510 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.131510 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.133183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.133183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.133183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.133183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.133183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.133542 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.133626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.133928 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.134237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.134550 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.134925 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.135244 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.135617 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.135935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.136296 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.136605 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.136964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.137289 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.137621 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.138075 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.138406 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.138570 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.138879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.139161 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.139598 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.139758 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.140252 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.140448 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.141118 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.141118 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.142558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.142558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.142558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.142558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.143132 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.143132 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.143722 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.144279 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.144681 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.145037 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.145485 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.148322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.148322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.148322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.148322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.148322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.148322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.148322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.148322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.149769 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.149769 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.149769 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.149769 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.149769 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.149769 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.150621 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.150767 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_db.sqlalchemy.engines [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:38:28.151052 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.151052 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.151052 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.151646 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.151646 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.151938 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.152208 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.152885 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.153112 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.153434 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.153755 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.154073 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.154392 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.154781 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.155029 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.155331 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.155538 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_db.sqlalchemy.engines [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:38:28.155703 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.156902 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.157237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.157940 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.157940 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.158281 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.158524 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.158791 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.159108 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.159740 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.159740 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.160153 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.160350 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.160682 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.161045 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.161444 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.161710 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.162034 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.162352 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.162673 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.165552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.165552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.165552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.165552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.165552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.165552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.165552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.166625 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.166625 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.166625 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.166625 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.166625 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.167403 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.167403 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.167403 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.168413 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.168413 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.168856 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.169482 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.169703 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.170275 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.170600 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.170943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.171278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.171698 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.172021 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.172354 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.172695 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.173065 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.173356 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.173678 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.173998 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.174311 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.174746 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.174958 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.175270 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.175742 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.175913 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.176889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.176889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.177225 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.177491 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.178554 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.178554 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.178554 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.179300 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.179300 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.179602 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.179763 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.180218 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.180543 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.180543 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.183191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.183191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.183191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.183191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.183191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.183191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.183191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.183191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.184663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.184663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.184663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.185343 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_db.sqlalchemy.engines [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:38:28.185528 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.185528 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.185528 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.185528 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.185528 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.186392 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.186392 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.186392 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.186827 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.186989 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.187741 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.188327 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.188729 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.189197 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.189360 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.189559 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.189889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.190223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.190508 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.190850 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.191173 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.191755 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.192674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.192674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.193051 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.193439 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.193439 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.193761 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.194044 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.194377 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.194694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.195003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.195324 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.195638 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.195955 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.196273 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.196590 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.196933 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.197250 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.197565 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.197885 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.198359 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.199667 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.199667 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.199667 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.199667 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.200738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.200738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.200738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.200738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.201503 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.201503 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.201799 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.202074 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.202514 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.203691 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.204052 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.204052 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.204357 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.204689 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.205063 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.205399 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.205817 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.206040 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.206348 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.206657 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.206973 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.207322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.207666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.207990 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.208322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.208720 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.209040 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.209334 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.209642 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.209933 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.210248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.210572 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.210931 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.211206 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.211527 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.211861 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.212176 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.212678 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.212941 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.213146 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.213476 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.214373 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.214373 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.214373 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.214918 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.215122 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.215437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.215755 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.216083 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.216415 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.216743 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.217086 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.217424 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.217741 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.218058 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.218402 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.218723 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.219016 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.219338 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.219673 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.220003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.220312 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.220643 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.220991 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.221319 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.221634 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.221948 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.222286 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.222606 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.222924 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.223237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.223551 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.223869 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.224189 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.224517 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.224869 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.225202 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.225535 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.225889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.226206 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.226555 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.226889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 14:38:28.227134 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 14:38:28.264512 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_db.sqlalchemy.engines [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:38:28.424138 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO keyring.backend [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Loading KWallet Dec 16 14:38:28.433118 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO keyring.backend [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Loading SecretService Dec 16 14:38:28.436503 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:38:28.436503 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: from cryptography.utils import int_from_bytes Dec 16 14:38:28.436855 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:38:28.436855 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: from cryptography.utils import int_from_bytes Dec 16 14:38:28.438155 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO keyring.backend [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Loading Windows Dec 16 14:38:28.440040 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO keyring.backend [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Loading chainer Dec 16 14:38:28.440838 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO keyring.backend [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Loading macOS Dec 16 14:38:28.518742 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.context [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f5f8018-539f-4757-94b5-f5fec5deb6e6(cell1) {{(pid=101915) load_cells /opt/stack/nova/nova/context.py:464}} Dec 16 14:38:28.523060 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:28.524728 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:28.525662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:38:28.527970 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:38:28.553803 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_db.sqlalchemy.engines [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:38:28.554636 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_db.sqlalchemy.engines [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:38:28.584885 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_db.sqlalchemy.engines [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:38:28.693544 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: WARNING keystonemiddleware.auth_token [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:38:28.700551 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: WARNING keystonemiddleware.auth_token [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:38:28.825810 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO keyring.backend [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Loading KWallet Dec 16 14:38:28.835169 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO keyring.backend [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Loading SecretService Dec 16 14:38:28.838635 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:38:28.838635 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: from cryptography.utils import int_from_bytes Dec 16 14:38:28.838966 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 16 14:38:28.838966 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: from cryptography.utils import int_from_bytes Dec 16 14:38:28.839713 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO keyring.backend [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Loading Windows Dec 16 14:38:28.842361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO keyring.backend [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Loading chainer Dec 16 14:38:28.843169 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO keyring.backend [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Loading macOS Dec 16 14:38:28.922682 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: WARNING keystonemiddleware.auth_token [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:38:28.927860 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: WARNING keystonemiddleware.auth_token [None req-d42485ec-0b24-44e5-9beb-a45bf21ab15b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:38:28.933241 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5586748799c0 pid: 101914 (default app) Dec 16 14:38:29.104922 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: WARNING keystonemiddleware.auth_token [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:38:29.111610 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: WARNING keystonemiddleware.auth_token [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:38:29.328859 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: WARNING keystonemiddleware.auth_token [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:38:29.334153 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: WARNING keystonemiddleware.auth_token [None req-6fcd3379-02a4-47cc-89bd-7cc4649ed6ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:38:29.339543 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586748799c0 pid: 101915 (default app) Dec 16 14:39:15.642464 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-496b4069-2f58-4259-92e6-4e01f6200632 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] Action: 'create', calling method: .version_select at 0x7f3c2d98fd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1015177591", "metadata": {"Type": "work"}}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:18.073207 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-496b4069-2f58-4259-92e6-4e01f6200632 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.234394 Dec 16 14:39:18.074187 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Dec 16 14:39:13 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 4237 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 16 14:39:18.094995 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ef2b9c1c-575a-4125-a1b3-6680c4e0a73e tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] Calling method '.version_select at 0x7f3c2d876040>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:18.396310 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ef2b9c1c-575a-4125-a1b3-6680c4e0a73e tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab" status: 200 len: 353 microversion: 2.1 time: 0.311566 Dec 16 14:39:18.398161 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 2/2] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:39:18 2021] GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab => generated 353 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:39:18.645449 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1367813721", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "networks": [{"uuid": "827b8a8e-1fe7-47ec-8dc7-4f6e2b249fc5"}]}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:19.411714 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-992ff15f-6481-4419-a225-ae66ce50d3c6 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] Calling method '.version_select at 0x7f3c2d8768b0>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:19.733016 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-992ff15f-6481-4419-a225-ae66ce50d3c6 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab" status: 200 len: 354 microversion: 2.1 time: 0.325703 Dec 16 14:39:19.734161 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 3/3] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:39:19 2021] GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab => generated 354 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:19.746405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3b0759f3-281c-4d5b-b85c-fba2138e74c1 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] Calling method '.version_select at 0x7f3c2d876e50>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:19.763510 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] validate_networks() for [('827b8a8e-1fe7-47ec-8dc7-4f6e2b249fc5', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:39:20.024812 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3b0759f3-281c-4d5b-b85c-fba2138e74c1 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab" status: 200 len: 354 microversion: 2.1 time: 0.283456 Dec 16 14:39:20.025784 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 4/4] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:39:19 2021] GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab => generated 354 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:39:20.037830 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-76705a5b-54b9-47dd-affe-5cb4057e15ef tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] Calling method '.version_select at 0x7f3c2d876550>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:20.259901 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-76705a5b-54b9-47dd-affe-5cb4057e15ef tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab" status: 202 len: 0 microversion: 2.1 time: 0.225505 Dec 16 14:39:20.260471 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 5/5] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Dec 16 14:39:20 2021] DELETE /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:39:20.270979 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b2ccf582-0e32-4b85-8eab-0db4596c2c73 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] Calling method '.version_select at 0x7f3c2d8750d0>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:20.508410 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b2ccf582-0e32-4b85-8eab-0db4596c2c73 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab" status: 200 len: 353 microversion: 2.1 time: 0.240273 Dec 16 14:39:20.509127 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 6/6] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:39:20 2021] GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab => generated 353 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:21.520952 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-6051210d-0d16-4908-b5df-8e55a06654c1 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] Calling method '.version_select at 0x7f3c2d876ee0>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:21.737438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-6051210d-0d16-4908-b5df-8e55a06654c1 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab" status: 200 len: 353 microversion: 2.1 time: 0.219604 Dec 16 14:39:21.738286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 7/7] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:39:21 2021] GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab => generated 353 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:39:22.447048 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:39:22.447576 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:39:22.447975 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:39:22.448389 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:39:22.448890 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:39:22.466762 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:22.467213 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:22.468055 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:22.468496 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:22.522090 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Getting quotas for project 6906ddb7ea8b4cde8dabbec416e0f996. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:39:22.539759 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Getting quotas for user c8d3e42caae84fedb52ba42d8763ee91 and project 6906ddb7ea8b4cde8dabbec416e0f996. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:39:22.563301 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:39:22.566935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:39:22.678747 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2effff0a-625e-40e4-a30f-580fe0fd45b3 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.803914 Dec 16 14:39:22.687670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 1/8] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:39:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 4814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 16 14:39:22.693294 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0e8d6b44-4d9a-4b9d-b498-d7be82d1ea7a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:22.694869 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0e8d6b44-4d9a-4b9d-b498-d7be82d1ea7a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:22.752554 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-658dc79a-1ba0-4981-9975-81d101c9d146 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] Calling method '.version_select at 0x7f3c2d7cdc10>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:23.071223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-658dc79a-1ba0-4981-9975-81d101c9d146 tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab" status: 200 len: 353 microversion: 2.1 time: 0.323574 Dec 16 14:39:23.072158 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 2/9] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:39:22 2021] GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab => generated 353 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:39:23.075600 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0e8d6b44-4d9a-4b9d-b498-d7be82d1ea7a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:23.088605 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0e8d6b44-4d9a-4b9d-b498-d7be82d1ea7a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1215 microversion: 2.1 time: 0.400891 Dec 16 14:39:23.101766 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 8/10] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:22 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1215 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:39:24.086774 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-950bb773-8790-425a-9e60-38355ef9adcf tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] Calling method '.version_select at 0x7f3c2d7f1940>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:24.118302 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-34125a97-7e8a-418f-99de-47fc5e574cda tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:24.118898 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-34125a97-7e8a-418f-99de-47fc5e574cda tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:24.223036 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-950bb773-8790-425a-9e60-38355ef9adcf tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] HTTP exception thrown: Volume 5b6b04f7-1224-4ad1-8bf0-89ecbca314ab could not be found. Dec 16 14:39:24.223648 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-950bb773-8790-425a-9e60-38355ef9adcf tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] Returning 404 to user: Volume 5b6b04f7-1224-4ad1-8bf0-89ecbca314ab could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:39:24.224505 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-950bb773-8790-425a-9e60-38355ef9adcf tempest-VolumesGetTestJSON-356262792 tempest-VolumesGetTestJSON-356262792-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab" status: 404 len: 109 microversion: 2.1 time: 0.141990 Dec 16 14:39:24.225112 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 3/11] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:39:24 2021] GET /compute/v2.1/os-volumes/5b6b04f7-1224-4ad1-8bf0-89ecbca314ab => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:39:24.687797 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-34125a97-7e8a-418f-99de-47fc5e574cda tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:24.700024 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-34125a97-7e8a-418f-99de-47fc5e574cda tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1215 microversion: 2.1 time: 0.585270 Dec 16 14:39:24.701427 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 9/12] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:24 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1215 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:39:25.721462 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-18f4812a-58d3-4b92-b279-23a4588adf50 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:25.722802 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-18f4812a-58d3-4b92-b279-23a4588adf50 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:25.740035 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-18f4812a-58d3-4b92-b279-23a4588adf50 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:25.740749 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-18f4812a-58d3-4b92-b279-23a4588adf50 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:25.741738 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-18f4812a-58d3-4b92-b279-23a4588adf50 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:25.742339 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-18f4812a-58d3-4b92-b279-23a4588adf50 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:25.806326 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2087375351", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03dcf6e0-5aa2-4eba-bb88-b06a640f61f9"}]}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:26.013280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] validate_networks() for [('03dcf6e0-5aa2-4eba-bb88-b06a640f61f9', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:39:26.469115 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-18f4812a-58d3-4b92-b279-23a4588adf50 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:26.492138 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-18f4812a-58d3-4b92-b279-23a4588adf50 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1267 microversion: 2.1 time: 0.774496 Dec 16 14:39:26.501919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 10/13] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:25 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1267 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:27.516622 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2bb86a5f-5bd7-4aba-b617-050a35f80fcf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:27.518413 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2bb86a5f-5bd7-4aba-b617-050a35f80fcf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:27.531748 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2bb86a5f-5bd7-4aba-b617-050a35f80fcf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:27.533904 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2bb86a5f-5bd7-4aba-b617-050a35f80fcf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:27.539550 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2bb86a5f-5bd7-4aba-b617-050a35f80fcf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:27.540306 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2bb86a5f-5bd7-4aba-b617-050a35f80fcf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:28.220514 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2bb86a5f-5bd7-4aba-b617-050a35f80fcf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:28.229441 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2bb86a5f-5bd7-4aba-b617-050a35f80fcf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1273 microversion: 2.1 time: 0.717456 Dec 16 14:39:28.255202 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 11/14] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:27 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1273 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:29.266893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1072a5ec-60ed-4ed1-a1bb-cb6bbf53d091 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:29.268854 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1072a5ec-60ed-4ed1-a1bb-cb6bbf53d091 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:29.306629 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1072a5ec-60ed-4ed1-a1bb-cb6bbf53d091 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:29.308817 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1072a5ec-60ed-4ed1-a1bb-cb6bbf53d091 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:29.309878 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1072a5ec-60ed-4ed1-a1bb-cb6bbf53d091 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:29.312119 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1072a5ec-60ed-4ed1-a1bb-cb6bbf53d091 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:30.157477 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:39:30.158609 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:39:30.159261 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:39:30.159818 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:39:30.160367 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:39:30.177008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:30.180925 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:30.184081 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:30.185987 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:30.246151 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Getting quotas for project ceb0da71791f4f9889daab33c73ac572. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:39:30.254790 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Getting quotas for user 4166133ac04844d491662feab2bd2d21 and project ceb0da71791f4f9889daab33c73ac572. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:39:30.287179 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:39:30.289897 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:39:30.423711 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-707814fc-ecd1-4e64-b0b1-9503913242f3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.011443 Dec 16 14:39:30.427135 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 4/15] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:39:25 2021] POST /compute/v2.1/servers => generated 383 bytes in 5018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:39:30.458167 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-37e65245-8d6c-4bdf-a39f-70e3d39899ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:30.460260 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-37e65245-8d6c-4bdf-a39f-70e3d39899ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:30.713314 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-37e65245-8d6c-4bdf-a39f-70e3d39899ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:30.765137 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-37e65245-8d6c-4bdf-a39f-70e3d39899ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1222 microversion: 2.1 time: 0.329237 Dec 16 14:39:30.766101 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 5/16] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:30 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1222 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:31.477980 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1072a5ec-60ed-4ed1-a1bb-cb6bbf53d091 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:31.511850 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1072a5ec-60ed-4ed1-a1bb-cb6bbf53d091 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 2.250132 Dec 16 14:39:31.524963 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2092712419", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03dcf6e0-5aa2-4eba-bb88-b06a640f61f9"}]}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:31.530174 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 12/17] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:29 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:31.864511 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] validate_networks() for [('03dcf6e0-5aa2-4eba-bb88-b06a640f61f9', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:39:33.346353 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f2225bf0-941e-448c-961c-ca12f78a83cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'create', calling method: .version_select at 0x7f3c2d754700>, body: {"keypair": {"name": "tempest-keypair-1934139766"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:33.522972 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-f2225bf0-941e-448c-961c-ca12f78a83cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for project 431320546381414684830eb2bc36deef. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:39:33.536955 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-f2225bf0-941e-448c-961c-ca12f78a83cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for user 18d85bcc0aeb413aa2ade769fd10e431 and project 431320546381414684830eb2bc36deef. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:39:33.729258 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:39:33.730414 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:39:33.731418 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:39:33.732131 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:39:33.733032 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:39:33.758704 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:33.759322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:33.761997 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:33.762649 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:33.847708 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Getting quotas for project ceb0da71791f4f9889daab33c73ac572. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:39:33.882202 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Getting quotas for user 4166133ac04844d491662feab2bd2d21 and project ceb0da71791f4f9889daab33c73ac572. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:39:33.910125 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:39:33.912753 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:39:34.036146 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7c6fa9b5-26bb-4dd3-8234-d926dbdee89e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.516759 Dec 16 14:39:34.049855 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 6/18] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:39:31 2021] POST /compute/v2.1/servers => generated 383 bytes in 2531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:39:34.073216 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d9132172-c8a3-4add-b3ed-d897566a773e tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:34.079051 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d9132172-c8a3-4add-b3ed-d897566a773e tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:34.110683 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d9132172-c8a3-4add-b3ed-d897566a773e tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:34.135343 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d9132172-c8a3-4add-b3ed-d897566a773e tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:34.152495 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d9132172-c8a3-4add-b3ed-d897566a773e tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:34.155919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d9132172-c8a3-4add-b3ed-d897566a773e tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:34.540615 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-f2225bf0-941e-448c-961c-ca12f78a83cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for project 431320546381414684830eb2bc36deef. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:39:34.573311 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-f2225bf0-941e-448c-961c-ca12f78a83cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for user 18d85bcc0aeb413aa2ade769fd10e431 and project 431320546381414684830eb2bc36deef. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:39:34.671984 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f2225bf0-941e-448c-961c-ca12f78a83cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.711373 Dec 16 14:39:34.677358 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 13/19] 10.222.0.64 () {62 vars in 1198 bytes} [Thu Dec 16 14:39:31 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2718 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:39:34.717028 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fa0b893d-8a44-45f1-907b-9e1480dcef94 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:34.720259 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fa0b893d-8a44-45f1-907b-9e1480dcef94 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:35.601951 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fa0b893d-8a44-45f1-907b-9e1480dcef94 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:35.647995 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fa0b893d-8a44-45f1-907b-9e1480dcef94 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1222 microversion: 2.1 time: 0.968832 Dec 16 14:39:35.652172 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 14/20] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:34 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1222 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:36.336095 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-884c6199-be79-459e-9967-5b5421d8dd2a req-ddffd627-198c-4a7d-90bb-75440ecd0b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e979fa-0671-444e-b47c-b9be04bd4bff", "tag": "985f8d8b-5b76-4176-800e-423ef68a9aa2"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:36.347706 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:39:36.347706 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:39:36.394317 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-884c6199-be79-459e-9967-5b5421d8dd2a req-ddffd627-198c-4a7d-90bb-75440ecd0b65 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:36.396028 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-884c6199-be79-459e-9967-5b5421d8dd2a req-ddffd627-198c-4a7d-90bb-75440ecd0b65 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:36.478564 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-884c6199-be79-459e-9967-5b5421d8dd2a req-ddffd627-198c-4a7d-90bb-75440ecd0b65 service nova] Creating event network-changed:985f8d8b-5b76-4176-800e-423ef68a9aa2 for instance d3e979fa-0671-444e-b47c-b9be04bd4bff on hv-cinder-82189 Dec 16 14:39:36.483820 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-884c6199-be79-459e-9967-5b5421d8dd2a req-ddffd627-198c-4a7d-90bb-75440ecd0b65 service nova] Acquired lock "compute-rpcapi-router" {{(pid=101914) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 14:39:36.486161 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7aa7fe89-fd55-4afc-a4e4-af18698304ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:36.488146 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7aa7fe89-fd55-4afc-a4e4-af18698304ea None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:36.492387 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7aa7fe89-fd55-4afc-a4e4-af18698304ea None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:36.495081 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7aa7fe89-fd55-4afc-a4e4-af18698304ea None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:36.534770 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.compute.rpcapi [None req-7aa7fe89-fd55-4afc-a4e4-af18698304ea None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Dec 16 14:39:36.539886 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7aa7fe89-fd55-4afc-a4e4-af18698304ea None None] Releasing lock "compute-rpcapi-router" {{(pid=101914) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 14:39:36.627665 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7aa7fe89-fd55-4afc-a4e4-af18698304ea None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.461705 Dec 16 14:39:36.635462 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 15/21] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:39:36.692379 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e839efbd-0086-41b5-a364-517613acc033 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:36.693865 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e839efbd-0086-41b5-a364-517613acc033 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:36.723086 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e839efbd-0086-41b5-a364-517613acc033 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:36.724251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e839efbd-0086-41b5-a364-517613acc033 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:36.738997 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e839efbd-0086-41b5-a364-517613acc033 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:36.740340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e839efbd-0086-41b5-a364-517613acc033 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:37.312521 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e839efbd-0086-41b5-a364-517613acc033 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:37.350278 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e839efbd-0086-41b5-a364-517613acc033 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1226 microversion: 2.1 time: 0.674603 Dec 16 14:39:37.352729 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 16/22] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:36 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1226 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:38.390654 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1cb1caca-1ff4-48f7-99e4-c054927791b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:38.391787 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1cb1caca-1ff4-48f7-99e4-c054927791b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:38.427413 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1cb1caca-1ff4-48f7-99e4-c054927791b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:38.428428 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1cb1caca-1ff4-48f7-99e4-c054927791b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:38.430127 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1cb1caca-1ff4-48f7-99e4-c054927791b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:38.434724 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1cb1caca-1ff4-48f7-99e4-c054927791b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:38.704394 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d9132172-c8a3-4add-b3ed-d897566a773e tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:38.725167 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d9132172-c8a3-4add-b3ed-d897566a773e tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 4.672569 Dec 16 14:39:38.728717 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 7/23] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:34 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 4678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:38.825020 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1cb1caca-1ff4-48f7-99e4-c054927791b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:38.842903 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1cb1caca-1ff4-48f7-99e4-c054927791b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1226 microversion: 2.1 time: 0.463245 Dec 16 14:39:38.846699 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 17/24] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:38 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1226 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:39:39.770600 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-775e4509-fa35-40d9-9302-63d4762e0faf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:39.775748 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-775e4509-fa35-40d9-9302-63d4762e0faf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:39.821224 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-775e4509-fa35-40d9-9302-63d4762e0faf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:39.824613 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-775e4509-fa35-40d9-9302-63d4762e0faf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:39.825502 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-775e4509-fa35-40d9-9302-63d4762e0faf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:39.825983 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-775e4509-fa35-40d9-9302-63d4762e0faf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:39.889474 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fb5b2fcc-25d2-480b-8400-7526f9ac5184 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2d705f70>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:40.318921 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fb5b2fcc-25d2-480b-8400-7526f9ac5184 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/d3786c32-1914-433b-871f-0ba893a51882" status: 200 len: 350 microversion: 2.1 time: 0.454127 Dec 16 14:39:40.322632 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 18/25] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:39:39 2021] GET /compute/v2.1/os-volumes/d3786c32-1914-433b-871f-0ba893a51882 => generated 350 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:40.366849 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8c86fddc-2884-4478-8348-7a4e60b2a1df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:40.372024 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8c86fddc-2884-4478-8348-7a4e60b2a1df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:40.427112 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8c86fddc-2884-4478-8348-7a4e60b2a1df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:40.428364 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8c86fddc-2884-4478-8348-7a4e60b2a1df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:40.430087 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8c86fddc-2884-4478-8348-7a4e60b2a1df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:40.434564 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8c86fddc-2884-4478-8348-7a4e60b2a1df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:41.559499 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-775e4509-fa35-40d9-9302-63d4762e0faf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:41.580689 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-775e4509-fa35-40d9-9302-63d4762e0faf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 1.830455 Dec 16 14:39:41.600269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 8/26] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:39 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:41.612005 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-238752456", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63997e9c-5e41-48b1-b719-91db81ce0d01"}], "security_groups": [{"name": "tempest-securitygroup--1518477876"}], "key_name": "tempest-keypair-1934139766", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:41.700403 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8c86fddc-2884-4478-8348-7a4e60b2a1df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:41.712267 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8c86fddc-2884-4478-8348-7a4e60b2a1df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1218 microversion: 2.1 time: 1.385698 Dec 16 14:39:41.733725 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 19/27] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:40 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1218 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:42.385360 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] validate_networks() for [('63997e9c-5e41-48b1-b719-91db81ce0d01', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:39:42.611025 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b07e21c0-6d89-49a7-ac14-4a720c1e0ebc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:42.611694 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b07e21c0-6d89-49a7-ac14-4a720c1e0ebc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:42.654805 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b07e21c0-6d89-49a7-ac14-4a720c1e0ebc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:42.655312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b07e21c0-6d89-49a7-ac14-4a720c1e0ebc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:42.656205 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b07e21c0-6d89-49a7-ac14-4a720c1e0ebc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:42.659297 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b07e21c0-6d89-49a7-ac14-4a720c1e0ebc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:43.739899 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b07e21c0-6d89-49a7-ac14-4a720c1e0ebc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:43.765558 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b07e21c0-6d89-49a7-ac14-4a720c1e0ebc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 1.153860 Dec 16 14:39:43.781905 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 20/28] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:42 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:43.795570 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d49fa8e8-6489-4e5e-b34c-6a9106a81501 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:43.796256 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d49fa8e8-6489-4e5e-b34c-6a9106a81501 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:43.806401 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d49fa8e8-6489-4e5e-b34c-6a9106a81501 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:43.807176 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d49fa8e8-6489-4e5e-b34c-6a9106a81501 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:43.821003 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d49fa8e8-6489-4e5e-b34c-6a9106a81501 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:43.821977 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d49fa8e8-6489-4e5e-b34c-6a9106a81501 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:44.282357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d49fa8e8-6489-4e5e-b34c-6a9106a81501 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:44.309545 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d49fa8e8-6489-4e5e-b34c-6a9106a81501 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1280 microversion: 2.1 time: 0.522496 Dec 16 14:39:44.314230 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 21/29] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:43 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1280 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:44.338947 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-cf618c53-50cb-4040-bfeb-e46543c6094c tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2d754940>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:45.222932 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-cf618c53-50cb-4040-bfeb-e46543c6094c tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/13d2f056-9d50-42c9-bd62-66d5e25abcda" status: 200 len: 351 microversion: 2.1 time: 0.904578 Dec 16 14:39:45.225078 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 22/30] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:39:44 2021] GET /compute/v2.1/os-volumes/13d2f056-9d50-42c9-bd62-66d5e25abcda => generated 351 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:45.233088 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7612459b-f1bd-4d51-b985-fe8ebe5d8c91 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:45.240100 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:39:45.241103 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:39:45.241103 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:39:45.241556 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:39:45.241975 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:39:45.249455 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7612459b-f1bd-4d51-b985-fe8ebe5d8c91 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:45.264285 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:45.268012 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:45.269873 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:45.271668 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:45.292575 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7612459b-f1bd-4d51-b985-fe8ebe5d8c91 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:45.293152 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7612459b-f1bd-4d51-b985-fe8ebe5d8c91 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:45.300529 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7612459b-f1bd-4d51-b985-fe8ebe5d8c91 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:45.305737 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7612459b-f1bd-4d51-b985-fe8ebe5d8c91 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:45.331353 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for project 431320546381414684830eb2bc36deef. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:39:45.341877 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for user 18d85bcc0aeb413aa2ade769fd10e431 and project 431320546381414684830eb2bc36deef. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:39:45.365563 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:39:45.370957 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:39:45.510165 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7cd5f5e3-e98b-48e8-8577-b3c5635642ec tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.907945 Dec 16 14:39:45.522674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 9/31] 10.222.0.64 () {62 vars in 1187 bytes} [Thu Dec 16 14:39:41 2021] POST /compute/v2.1/servers => generated 402 bytes in 3921 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 16 14:39:45.538098 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-bb24b7b0-fd88-414a-9660-a923abf375a3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:45.538731 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-bb24b7b0-fd88-414a-9660-a923abf375a3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:45.559578 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bb24b7b0-fd88-414a-9660-a923abf375a3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:45.560043 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bb24b7b0-fd88-414a-9660-a923abf375a3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:45.560872 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bb24b7b0-fd88-414a-9660-a923abf375a3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:45.561320 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bb24b7b0-fd88-414a-9660-a923abf375a3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:46.138787 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7612459b-f1bd-4d51-b985-fe8ebe5d8c91 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:46.153138 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7612459b-f1bd-4d51-b985-fe8ebe5d8c91 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 0.926556 Dec 16 14:39:46.153752 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 23/32] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:45 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:46.264759 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-bb24b7b0-fd88-414a-9660-a923abf375a3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:46.275214 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-bb24b7b0-fd88-414a-9660-a923abf375a3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.750855 Dec 16 14:39:46.285587 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-94b0b317-cb5f-43ec-9442-6908c8a8a856 req-1331e906-8a56-459d-8041-7ecead6441dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afaa3d8-bcc9-4473-807c-ea33c70e2d05", "tag": "33fce9f6-5ac0-4aa0-996a-ade01b65bda3"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:46.287674 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:39:46.287674 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:39:46.290845 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 10/33] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:45 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:46.303254 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d33d274a-03cc-4357-94bc-2c4e67174d19 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:46.328256 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d33d274a-03cc-4357-94bc-2c4e67174d19 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:46.332016 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-94b0b317-cb5f-43ec-9442-6908c8a8a856 req-1331e906-8a56-459d-8041-7ecead6441dc service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:46.346384 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-94b0b317-cb5f-43ec-9442-6908c8a8a856 req-1331e906-8a56-459d-8041-7ecead6441dc service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:46.377284 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d33d274a-03cc-4357-94bc-2c4e67174d19 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:46.384316 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d33d274a-03cc-4357-94bc-2c4e67174d19 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:46.389274 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d33d274a-03cc-4357-94bc-2c4e67174d19 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:46.393248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d33d274a-03cc-4357-94bc-2c4e67174d19 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:46.414075 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-94b0b317-cb5f-43ec-9442-6908c8a8a856 req-1331e906-8a56-459d-8041-7ecead6441dc service nova] Creating event network-changed:33fce9f6-5ac0-4aa0-996a-ade01b65bda3 for instance 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 on hv-cinder-82189 Dec 16 14:39:46.429684 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-94b0b317-cb5f-43ec-9442-6908c8a8a856 req-1331e906-8a56-459d-8041-7ecead6441dc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274468 Dec 16 14:39:46.430363 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 24/34] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:39:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:46.654625 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d33d274a-03cc-4357-94bc-2c4e67174d19 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:46.669417 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d33d274a-03cc-4357-94bc-2c4e67174d19 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:46.672627 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d33d274a-03cc-4357-94bc-2c4e67174d19 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:46.675824 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d33d274a-03cc-4357-94bc-2c4e67174d19 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1285 microversion: 2.20 time: 0.383422 Dec 16 14:39:46.696970 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 11/35] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:39:46 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1285 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:39:46.961461 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-3acaf9bf-0f2c-479e-b11c-65a5746212fd req-c4e6df84-a762-4d7c-a63f-560d045539a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d89b92-839c-4c63-ae4d-71c0a98797ea", "tag": "9f4e36fb-6721-4f46-ae0e-4c3561ce55f0"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:46.965054 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:39:46.965054 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:39:46.979048 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-3acaf9bf-0f2c-479e-b11c-65a5746212fd req-c4e6df84-a762-4d7c-a63f-560d045539a2 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:46.979771 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-3acaf9bf-0f2c-479e-b11c-65a5746212fd req-c4e6df84-a762-4d7c-a63f-560d045539a2 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:47.004721 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-3acaf9bf-0f2c-479e-b11c-65a5746212fd req-c4e6df84-a762-4d7c-a63f-560d045539a2 service nova] Creating event network-changed:9f4e36fb-6721-4f46-ae0e-4c3561ce55f0 for instance 55d89b92-839c-4c63-ae4d-71c0a98797ea on hv-cinder-82189 Dec 16 14:39:47.009461 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-3acaf9bf-0f2c-479e-b11c-65a5746212fd req-c4e6df84-a762-4d7c-a63f-560d045539a2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055344 Dec 16 14:39:47.010303 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 25/36] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:39:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:47.172293 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1dfca6ee-3828-4cdb-af44-91c6ad4ab575 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:47.173324 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1dfca6ee-3828-4cdb-af44-91c6ad4ab575 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:47.184583 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1dfca6ee-3828-4cdb-af44-91c6ad4ab575 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:47.185346 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1dfca6ee-3828-4cdb-af44-91c6ad4ab575 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:47.186309 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1dfca6ee-3828-4cdb-af44-91c6ad4ab575 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:47.186789 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1dfca6ee-3828-4cdb-af44-91c6ad4ab575 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:47.295871 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7b297657-3bc5-43f4-a1e1-72be164b1377 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:47.296603 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7b297657-3bc5-43f4-a1e1-72be164b1377 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:47.304393 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7b297657-3bc5-43f4-a1e1-72be164b1377 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:47.304933 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7b297657-3bc5-43f4-a1e1-72be164b1377 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:47.305798 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7b297657-3bc5-43f4-a1e1-72be164b1377 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:47.306684 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7b297657-3bc5-43f4-a1e1-72be164b1377 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:47.467500 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1dfca6ee-3828-4cdb-af44-91c6ad4ab575 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:47.475963 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1dfca6ee-3828-4cdb-af44-91c6ad4ab575 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 0.308171 Dec 16 14:39:47.476556 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 12/37] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:47 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:47.568683 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7b297657-3bc5-43f4-a1e1-72be164b1377 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:47.578923 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7b297657-3bc5-43f4-a1e1-72be164b1377 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.287640 Dec 16 14:39:47.579501 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 26/38] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:47 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:39:47.706001 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c8862884-9799-4c21-aec2-df2e668aedea tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:47.706666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c8862884-9799-4c21-aec2-df2e668aedea tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:47.722578 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8862884-9799-4c21-aec2-df2e668aedea tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:47.723329 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8862884-9799-4c21-aec2-df2e668aedea tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:47.724469 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8862884-9799-4c21-aec2-df2e668aedea tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:47.724971 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8862884-9799-4c21-aec2-df2e668aedea tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:47.873557 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c8862884-9799-4c21-aec2-df2e668aedea tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:47.882917 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c8862884-9799-4c21-aec2-df2e668aedea tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:47.905022 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c8862884-9799-4c21-aec2-df2e668aedea tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:47.906156 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c8862884-9799-4c21-aec2-df2e668aedea tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1285 microversion: 2.20 time: 0.204107 Dec 16 14:39:47.906743 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 13/39] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:39:47 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:39:48.501225 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c0455613-f07c-4e2d-8112-2500f9fa6292 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:48.503056 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c0455613-f07c-4e2d-8112-2500f9fa6292 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:48.510839 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c0455613-f07c-4e2d-8112-2500f9fa6292 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:48.511553 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c0455613-f07c-4e2d-8112-2500f9fa6292 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:48.512336 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c0455613-f07c-4e2d-8112-2500f9fa6292 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:48.512937 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c0455613-f07c-4e2d-8112-2500f9fa6292 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:48.612915 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e9a4aec8-ba74-4d3f-9b84-51b33b9470c4 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:48.614063 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e9a4aec8-ba74-4d3f-9b84-51b33b9470c4 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:48.627557 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e9a4aec8-ba74-4d3f-9b84-51b33b9470c4 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:48.628105 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e9a4aec8-ba74-4d3f-9b84-51b33b9470c4 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:48.629431 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e9a4aec8-ba74-4d3f-9b84-51b33b9470c4 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:48.630129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e9a4aec8-ba74-4d3f-9b84-51b33b9470c4 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:48.893737 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c0455613-f07c-4e2d-8112-2500f9fa6292 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:48.910347 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c0455613-f07c-4e2d-8112-2500f9fa6292 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 0.415455 Dec 16 14:39:48.913211 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 27/40] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:48 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:48.934569 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-06b1a6ab-496b-46de-aa73-c344c0b2a7cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:48.935558 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-06b1a6ab-496b-46de-aa73-c344c0b2a7cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:48.962064 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-06b1a6ab-496b-46de-aa73-c344c0b2a7cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:48.968344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-06b1a6ab-496b-46de-aa73-c344c0b2a7cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:48.970073 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-06b1a6ab-496b-46de-aa73-c344c0b2a7cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:48.970690 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-06b1a6ab-496b-46de-aa73-c344c0b2a7cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:49.080985 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e9a4aec8-ba74-4d3f-9b84-51b33b9470c4 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:49.106407 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e9a4aec8-ba74-4d3f-9b84-51b33b9470c4 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.503514 Dec 16 14:39:49.108737 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 14/41] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:48 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:49.212604 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-06b1a6ab-496b-46de-aa73-c344c0b2a7cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:49.223092 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-06b1a6ab-496b-46de-aa73-c344c0b2a7cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:49.224819 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-06b1a6ab-496b-46de-aa73-c344c0b2a7cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:49.226898 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-06b1a6ab-496b-46de-aa73-c344c0b2a7cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1285 microversion: 2.20 time: 0.301479 Dec 16 14:39:49.241096 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 28/42] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:39:48 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1285 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:39:49.931380 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7c8f052c-64d1-4d11-b3b9-46baf2757852 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:49.932533 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7c8f052c-64d1-4d11-b3b9-46baf2757852 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:49.941677 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7c8f052c-64d1-4d11-b3b9-46baf2757852 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:49.943208 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7c8f052c-64d1-4d11-b3b9-46baf2757852 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:49.944266 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7c8f052c-64d1-4d11-b3b9-46baf2757852 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:49.945071 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7c8f052c-64d1-4d11-b3b9-46baf2757852 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:49.977840 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-6cb2338a-b5a3-4f2e-90ad-b4ebbffef268 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2c675040>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:50.116171 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-6cb2338a-b5a3-4f2e-90ad-b4ebbffef268 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/21312a7f-3aaa-47d5-aa87-ebe2889b78c1" status: 200 len: 351 microversion: 2.1 time: 0.146469 Dec 16 14:39:50.117112 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 29/43] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:39:49 2021] GET /compute/v2.1/os-volumes/21312a7f-3aaa-47d5-aa87-ebe2889b78c1 => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:50.125800 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7cc303c4-64ce-4a73-9c8c-bf47a76e2f3b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:50.126729 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7cc303c4-64ce-4a73-9c8c-bf47a76e2f3b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:50.134480 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7cc303c4-64ce-4a73-9c8c-bf47a76e2f3b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:50.135553 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7cc303c4-64ce-4a73-9c8c-bf47a76e2f3b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:50.136580 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7cc303c4-64ce-4a73-9c8c-bf47a76e2f3b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:50.137104 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7cc303c4-64ce-4a73-9c8c-bf47a76e2f3b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:50.815982 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7c8f052c-64d1-4d11-b3b9-46baf2757852 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:50.825532 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7c8f052c-64d1-4d11-b3b9-46baf2757852 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 0.899125 Dec 16 14:39:50.838678 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 15/44] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:49 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:50.843452 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-cf385b03-50d0-4c91-b106-a2514cb235a7 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2cf09f70>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:50.974498 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7cc303c4-64ce-4a73-9c8c-bf47a76e2f3b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:51.004079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7cc303c4-64ce-4a73-9c8c-bf47a76e2f3b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.881884 Dec 16 14:39:51.007841 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 30/45] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:50 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:51.019715 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-cf385b03-50d0-4c91-b106-a2514cb235a7 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.179685 Dec 16 14:39:51.020749 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-08c9927b-614a-4e91-b076-2c20bc5bdfb5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:51.021494 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 16/46] 10.222.0.64 () {58 vars in 1133 bytes} [Thu Dec 16 14:39:50 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:51.029095 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-08c9927b-614a-4e91-b076-2c20bc5bdfb5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:51.037599 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-185484db-b1b6-4604-ab48-b3d81ce0ecfb tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2d973550>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:51.038309 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-08c9927b-614a-4e91-b076-2c20bc5bdfb5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:51.038981 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-08c9927b-614a-4e91-b076-2c20bc5bdfb5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:51.040027 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-08c9927b-614a-4e91-b076-2c20bc5bdfb5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:51.040678 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-08c9927b-614a-4e91-b076-2c20bc5bdfb5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:51.143519 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-185484db-b1b6-4604-ab48-b3d81ce0ecfb tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.113288 Dec 16 14:39:51.151373 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 17/47] 10.222.0.64 () {58 vars in 1148 bytes} [Thu Dec 16 14:39:51 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:39:51.156369 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a673fe53-5747-4ca9-82c3-afd9ef7dd794 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2ce90c10>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:51.253962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a673fe53-5747-4ca9-82c3-afd9ef7dd794 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.101206 Dec 16 14:39:51.255141 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 18/48] 10.222.0.64 () {58 vars in 1133 bytes} [Thu Dec 16 14:39:51 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:51.263410 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-08c9927b-614a-4e91-b076-2c20bc5bdfb5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:51.277979 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-73cbf4c0-f1b4-4fd0-a1fb-550c6198026f tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2d9734c0>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:51.286368 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-08c9927b-614a-4e91-b076-2c20bc5bdfb5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:51.291213 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-08c9927b-614a-4e91-b076-2c20bc5bdfb5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:51.296016 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-08c9927b-614a-4e91-b076-2c20bc5bdfb5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1333 microversion: 2.20 time: 0.284595 Dec 16 14:39:51.299220 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 31/49] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:39:51 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1333 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:39:51.411643 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-73cbf4c0-f1b4-4fd0-a1fb-550c6198026f tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.146095 Dec 16 14:39:51.412524 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 19/50] 10.222.0.64 () {58 vars in 1166 bytes} [Thu Dec 16 14:39:51 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:51.424569 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-09994f04-a6ea-4484-9ea0-49226165c6bc tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2c675940>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:51.510565 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-09994f04-a6ea-4484-9ea0-49226165c6bc tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089541 Dec 16 14:39:51.511256 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 32/51] 10.222.0.64 () {58 vars in 1169 bytes} [Thu Dec 16 14:39:51 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:51.522988 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fdac4f00-29f7-4cdc-81a0-5a9b25878e23 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2ce6e5e0>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:51.608032 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fdac4f00-29f7-4cdc-81a0-5a9b25878e23 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088690 Dec 16 14:39:51.608597 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 20/52] 10.222.0.64 () {58 vars in 1154 bytes} [Thu Dec 16 14:39:51 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:51.619913 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2b1e8221-2415-4bd1-a130-78ac1888cb7f tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2d778ca0>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:51.707014 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2b1e8221-2415-4bd1-a130-78ac1888cb7f tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090874 Dec 16 14:39:51.707584 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 33/53] 10.222.0.64 () {58 vars in 1187 bytes} [Thu Dec 16 14:39:51 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:51.720251 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-54b73e6a-2d3d-4d68-8262-54938cd46e75 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] Calling method '.version_select at 0x7f3c2ce90550>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:51.846390 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-54b73e6a-2d3d-4d68-8262-54938cd46e75 tempest-VolumesTestJSON-54513612 tempest-VolumesTestJSON-54513612-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.130015 Dec 16 14:39:51.846972 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 21/54] 10.222.0.64 () {58 vars in 1154 bytes} [Thu Dec 16 14:39:51 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:51.857906 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bafe81ff-c422-4e09-b397-b7c9156d576b tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:51.858861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bafe81ff-c422-4e09-b397-b7c9156d576b tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:51.896355 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bafe81ff-c422-4e09-b397-b7c9156d576b tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:51.897648 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bafe81ff-c422-4e09-b397-b7c9156d576b tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:51.903099 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bafe81ff-c422-4e09-b397-b7c9156d576b tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:51.906948 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bafe81ff-c422-4e09-b397-b7c9156d576b tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:52.024267 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2b2d21f6-10a4-4027-a5b8-d4799e54ff1d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:52.025009 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2b2d21f6-10a4-4027-a5b8-d4799e54ff1d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:52.044314 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b2d21f6-10a4-4027-a5b8-d4799e54ff1d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:52.044825 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b2d21f6-10a4-4027-a5b8-d4799e54ff1d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:52.046721 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b2d21f6-10a4-4027-a5b8-d4799e54ff1d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:52.047237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b2d21f6-10a4-4027-a5b8-d4799e54ff1d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:52.375295 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bafe81ff-c422-4e09-b397-b7c9156d576b tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:52.388305 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bafe81ff-c422-4e09-b397-b7c9156d576b tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 0.536089 Dec 16 14:39:52.390102 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 34/55] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:51 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:52.400999 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4e89e67d-34c6-4f3c-a4c7-9578807b4268 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:52.403611 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4e89e67d-34c6-4f3c-a4c7-9578807b4268 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:52.417975 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4e89e67d-34c6-4f3c-a4c7-9578807b4268 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:52.419058 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4e89e67d-34c6-4f3c-a4c7-9578807b4268 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:52.420506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4e89e67d-34c6-4f3c-a4c7-9578807b4268 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:52.421833 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4e89e67d-34c6-4f3c-a4c7-9578807b4268 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:52.586531 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2b2d21f6-10a4-4027-a5b8-d4799e54ff1d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:52.602806 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2b2d21f6-10a4-4027-a5b8-d4799e54ff1d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.582496 Dec 16 14:39:52.604522 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 22/56] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:52 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:52.669802 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4e89e67d-34c6-4f3c-a4c7-9578807b4268 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:52.687676 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4e89e67d-34c6-4f3c-a4c7-9578807b4268 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:52.691289 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4e89e67d-34c6-4f3c-a4c7-9578807b4268 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:52.693438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4e89e67d-34c6-4f3c-a4c7-9578807b4268 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1339 microversion: 2.20 time: 0.300936 Dec 16 14:39:52.694702 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 35/57] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:39:52 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1339 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:39:53.413731 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b5ad1c76-76b4-4994-9d37-a1b43f8d4705 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:53.414571 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b5ad1c76-76b4-4994-9d37-a1b43f8d4705 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:53.422561 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5ad1c76-76b4-4994-9d37-a1b43f8d4705 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:53.423009 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5ad1c76-76b4-4994-9d37-a1b43f8d4705 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:53.424011 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5ad1c76-76b4-4994-9d37-a1b43f8d4705 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:53.424448 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5ad1c76-76b4-4994-9d37-a1b43f8d4705 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:53.625252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-db11b785-b190-4674-b8b7-08d038b0210e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:53.625865 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-db11b785-b190-4674-b8b7-08d038b0210e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:53.633475 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-db11b785-b190-4674-b8b7-08d038b0210e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:53.634039 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-db11b785-b190-4674-b8b7-08d038b0210e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:53.635738 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-db11b785-b190-4674-b8b7-08d038b0210e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:53.636338 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-db11b785-b190-4674-b8b7-08d038b0210e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:53.667033 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b5ad1c76-76b4-4994-9d37-a1b43f8d4705 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:53.678261 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b5ad1c76-76b4-4994-9d37-a1b43f8d4705 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 0.268526 Dec 16 14:39:53.679242 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 23/58] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:53 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:53.718513 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3c26152d-9cd2-4960-9d18-11466e7454e6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:53.719600 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3c26152d-9cd2-4960-9d18-11466e7454e6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:53.728530 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3c26152d-9cd2-4960-9d18-11466e7454e6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:53.741229 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3c26152d-9cd2-4960-9d18-11466e7454e6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:53.742388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3c26152d-9cd2-4960-9d18-11466e7454e6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:53.745164 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3c26152d-9cd2-4960-9d18-11466e7454e6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:53.950864 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-3c26152d-9cd2-4960-9d18-11466e7454e6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:53.961501 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-3c26152d-9cd2-4960-9d18-11466e7454e6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:53.961873 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-db11b785-b190-4674-b8b7-08d038b0210e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:53.963146 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-3c26152d-9cd2-4960-9d18-11466e7454e6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:53.964373 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3c26152d-9cd2-4960-9d18-11466e7454e6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1339 microversion: 2.20 time: 0.255778 Dec 16 14:39:53.965334 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 24/59] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:39:53 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1339 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:39:53.971781 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-db11b785-b190-4674-b8b7-08d038b0210e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.350760 Dec 16 14:39:53.972686 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 36/60] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:53 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:39:54.698250 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ee22e270-ac9f-48ea-ad20-2f530d6af209 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:54.699640 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ee22e270-ac9f-48ea-ad20-2f530d6af209 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:54.714161 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee22e270-ac9f-48ea-ad20-2f530d6af209 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:54.714627 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee22e270-ac9f-48ea-ad20-2f530d6af209 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:54.720491 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee22e270-ac9f-48ea-ad20-2f530d6af209 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:54.720907 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee22e270-ac9f-48ea-ad20-2f530d6af209 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:54.997477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5ac74ea0-5ead-449a-ba86-ebb8eded3ae1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:54.998106 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5ac74ea0-5ead-449a-ba86-ebb8eded3ae1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:55.022481 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ac74ea0-5ead-449a-ba86-ebb8eded3ae1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:55.022986 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ac74ea0-5ead-449a-ba86-ebb8eded3ae1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:55.024011 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ac74ea0-5ead-449a-ba86-ebb8eded3ae1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:55.024470 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ac74ea0-5ead-449a-ba86-ebb8eded3ae1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:55.301207 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5ac74ea0-5ead-449a-ba86-ebb8eded3ae1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:55.312815 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5ac74ea0-5ead-449a-ba86-ebb8eded3ae1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:55.315286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5ac74ea0-5ead-449a-ba86-ebb8eded3ae1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:55.316858 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5ac74ea0-5ead-449a-ba86-ebb8eded3ae1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1339 microversion: 2.20 time: 0.323106 Dec 16 14:39:55.318129 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 37/61] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:39:54 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1339 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:39:55.332208 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-602eba50-d400-443f-8313-61a988408203 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:55.333067 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-602eba50-d400-443f-8313-61a988408203 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:55.346963 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-602eba50-d400-443f-8313-61a988408203 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:55.347835 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-602eba50-d400-443f-8313-61a988408203 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:55.348946 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-602eba50-d400-443f-8313-61a988408203 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:55.349578 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-602eba50-d400-443f-8313-61a988408203 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:55.715601 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ee22e270-ac9f-48ea-ad20-2f530d6af209 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:55.729173 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ee22e270-ac9f-48ea-ad20-2f530d6af209 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 1.035922 Dec 16 14:39:55.732191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 25/62] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:54 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:56.141011 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-602eba50-d400-443f-8313-61a988408203 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:56.151926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-602eba50-d400-443f-8313-61a988408203 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.831934 Dec 16 14:39:56.154405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 38/63] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:55 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:56.339825 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-712fe4a2-3077-43c5-b6c3-d2a5beb2c752 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:56.340375 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-712fe4a2-3077-43c5-b6c3-d2a5beb2c752 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:56.353665 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-712fe4a2-3077-43c5-b6c3-d2a5beb2c752 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:56.354140 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-712fe4a2-3077-43c5-b6c3-d2a5beb2c752 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:56.357388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-712fe4a2-3077-43c5-b6c3-d2a5beb2c752 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:56.359388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-712fe4a2-3077-43c5-b6c3-d2a5beb2c752 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:56.750609 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b251e141-c60d-48d4-ac66-bccf2c9fc4ed tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:56.752255 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b251e141-c60d-48d4-ac66-bccf2c9fc4ed tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:56.787353 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b251e141-c60d-48d4-ac66-bccf2c9fc4ed tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:56.795614 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b251e141-c60d-48d4-ac66-bccf2c9fc4ed tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:56.798610 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b251e141-c60d-48d4-ac66-bccf2c9fc4ed tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:56.802608 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b251e141-c60d-48d4-ac66-bccf2c9fc4ed tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:57.205713 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-712fe4a2-3077-43c5-b6c3-d2a5beb2c752 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:57.222990 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-712fe4a2-3077-43c5-b6c3-d2a5beb2c752 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:57.226496 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-712fe4a2-3077-43c5-b6c3-d2a5beb2c752 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:57.235504 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-712fe4a2-3077-43c5-b6c3-d2a5beb2c752 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1407 microversion: 2.20 time: 0.896311 Dec 16 14:39:57.237556 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 26/64] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:39:56 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1407 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:39:57.248827 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7cff062c-d86e-4cae-a184-d2b151bcae9c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:57.250112 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7cff062c-d86e-4cae-a184-d2b151bcae9c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:57.272611 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cff062c-d86e-4cae-a184-d2b151bcae9c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:57.274580 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cff062c-d86e-4cae-a184-d2b151bcae9c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:57.276209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cff062c-d86e-4cae-a184-d2b151bcae9c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:57.276648 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cff062c-d86e-4cae-a184-d2b151bcae9c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:57.363200 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b251e141-c60d-48d4-ac66-bccf2c9fc4ed tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:57.374997 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b251e141-c60d-48d4-ac66-bccf2c9fc4ed tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 0.631302 Dec 16 14:39:57.377051 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 39/65] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:56 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:57.730655 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7cff062c-d86e-4cae-a184-d2b151bcae9c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:57.752426 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7cff062c-d86e-4cae-a184-d2b151bcae9c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.513543 Dec 16 14:39:57.763041 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 27/66] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:57 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:39:58.256207 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-144a2dca-5deb-455d-bbee-ad3e2c1ddbb1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:58.257207 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-144a2dca-5deb-455d-bbee-ad3e2c1ddbb1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:58.274348 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-144a2dca-5deb-455d-bbee-ad3e2c1ddbb1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:58.278498 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-144a2dca-5deb-455d-bbee-ad3e2c1ddbb1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:58.280345 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-144a2dca-5deb-455d-bbee-ad3e2c1ddbb1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:58.282371 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-144a2dca-5deb-455d-bbee-ad3e2c1ddbb1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:58.394564 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-994d0383-dc6c-4696-99fb-da757d074709 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:58.395305 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-994d0383-dc6c-4696-99fb-da757d074709 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:58.418841 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-994d0383-dc6c-4696-99fb-da757d074709 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:58.419310 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-994d0383-dc6c-4696-99fb-da757d074709 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:58.420122 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-994d0383-dc6c-4696-99fb-da757d074709 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:58.420567 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-994d0383-dc6c-4696-99fb-da757d074709 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:58.788337 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-144a2dca-5deb-455d-bbee-ad3e2c1ddbb1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:58.799725 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-144a2dca-5deb-455d-bbee-ad3e2c1ddbb1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:58.809326 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-144a2dca-5deb-455d-bbee-ad3e2c1ddbb1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:58.810686 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-144a2dca-5deb-455d-bbee-ad3e2c1ddbb1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1407 microversion: 2.20 time: 0.558467 Dec 16 14:39:58.830817 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 40/67] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:39:58 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1407 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:39:58.955086 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-994d0383-dc6c-4696-99fb-da757d074709 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:39:58.966805 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-994d0383-dc6c-4696-99fb-da757d074709 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 0.576629 Dec 16 14:39:58.983403 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 28/68] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:58 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:39:58.991009 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-5c2682b6-3c95-4ab4-a128-5ab544f7af1c req-53ac8fe8-842f-44f2-b1c2-9ca1244cdbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e7a3c6-dc99-4927-83c2-dd8ba87239b2", "tag": "3086416d-8f44-45e7-a877-073ca8530605"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:59.001685 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:39:59.001685 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:39:59.026232 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-5c2682b6-3c95-4ab4-a128-5ab544f7af1c req-53ac8fe8-842f-44f2-b1c2-9ca1244cdbc8 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:59.026918 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-5c2682b6-3c95-4ab4-a128-5ab544f7af1c req-53ac8fe8-842f-44f2-b1c2-9ca1244cdbc8 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:59.101235 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-5c2682b6-3c95-4ab4-a128-5ab544f7af1c req-53ac8fe8-842f-44f2-b1c2-9ca1244cdbc8 service nova] Creating event network-changed:3086416d-8f44-45e7-a877-073ca8530605 for instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 on hv-cinder-82189 Dec 16 14:39:59.112761 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-5c2682b6-3c95-4ab4-a128-5ab544f7af1c req-53ac8fe8-842f-44f2-b1c2-9ca1244cdbc8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=101915) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 14:39:59.125215 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c639e0bd-9a90-43da-8a9a-b5ce25e4ec17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:59.127499 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c639e0bd-9a90-43da-8a9a-b5ce25e4ec17 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:59.129670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c639e0bd-9a90-43da-8a9a-b5ce25e4ec17 None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:59.133983 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c639e0bd-9a90-43da-8a9a-b5ce25e4ec17 None None] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:59.171489 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.compute.rpcapi [None req-c639e0bd-9a90-43da-8a9a-b5ce25e4ec17 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Dec 16 14:39:59.172757 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c639e0bd-9a90-43da-8a9a-b5ce25e4ec17 None None] Releasing lock "compute-rpcapi-router" {{(pid=101915) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 14:39:59.257542 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c639e0bd-9a90-43da-8a9a-b5ce25e4ec17 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272290 Dec 16 14:39:59.258161 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 29/69] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:59.266941 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4fe2dbf8-2a9d-46d6-bae7-3cad97dfa1be tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:59.268197 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4fe2dbf8-2a9d-46d6-bae7-3cad97dfa1be tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:59.311415 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-c7381bb1-92d7-4081-9df8-19419ff4008b req-4744c360-6d76-417f-9ef3-71080ed192e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e979fa-0671-444e-b47c-b9be04bd4bff", "name": "network-vif-plugged", "status": "completed", "tag": "985f8d8b-5b76-4176-800e-423ef68a9aa2"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:39:59.313685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:39:59.313685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:39:59.319015 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4fe2dbf8-2a9d-46d6-bae7-3cad97dfa1be tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:59.319487 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4fe2dbf8-2a9d-46d6-bae7-3cad97dfa1be tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:59.320299 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4fe2dbf8-2a9d-46d6-bae7-3cad97dfa1be tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:59.320742 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4fe2dbf8-2a9d-46d6-bae7-3cad97dfa1be tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:59.336679 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-c7381bb1-92d7-4081-9df8-19419ff4008b req-4744c360-6d76-417f-9ef3-71080ed192e8 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:59.337751 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-c7381bb1-92d7-4081-9df8-19419ff4008b req-4744c360-6d76-417f-9ef3-71080ed192e8 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:59.378387 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-c7381bb1-92d7-4081-9df8-19419ff4008b req-4744c360-6d76-417f-9ef3-71080ed192e8 service nova] Creating event network-vif-plugged:985f8d8b-5b76-4176-800e-423ef68a9aa2 for instance d3e979fa-0671-444e-b47c-b9be04bd4bff on hv-cinder-82189 Dec 16 14:39:59.388673 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-c7381bb1-92d7-4081-9df8-19419ff4008b req-4744c360-6d76-417f-9ef3-71080ed192e8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.556460 Dec 16 14:39:59.389680 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 41/70] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:39:59.836350 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-797934f8-a9e2-4e7a-872d-dc48ed5dec4f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:39:59.837802 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-797934f8-a9e2-4e7a-872d-dc48ed5dec4f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:39:59.856245 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-797934f8-a9e2-4e7a-872d-dc48ed5dec4f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:59.856985 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-797934f8-a9e2-4e7a-872d-dc48ed5dec4f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:39:59.858146 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-797934f8-a9e2-4e7a-872d-dc48ed5dec4f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:39:59.858738 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-797934f8-a9e2-4e7a-872d-dc48ed5dec4f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:00.100210 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4fe2dbf8-2a9d-46d6-bae7-3cad97dfa1be tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:00.116023 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4fe2dbf8-2a9d-46d6-bae7-3cad97dfa1be tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.856092 Dec 16 14:40:00.118155 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 30/71] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:39:59 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:00.136437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4498a766-a18c-45c7-a172-523159f3a015 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:00.137852 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4498a766-a18c-45c7-a172-523159f3a015 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:00.147432 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4498a766-a18c-45c7-a172-523159f3a015 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:00.147890 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4498a766-a18c-45c7-a172-523159f3a015 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:00.149064 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4498a766-a18c-45c7-a172-523159f3a015 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:00.149655 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4498a766-a18c-45c7-a172-523159f3a015 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:00.441393 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-797934f8-a9e2-4e7a-872d-dc48ed5dec4f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:00.455932 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-797934f8-a9e2-4e7a-872d-dc48ed5dec4f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:00.461947 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-797934f8-a9e2-4e7a-872d-dc48ed5dec4f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:00.467946 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-797934f8-a9e2-4e7a-872d-dc48ed5dec4f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1407 microversion: 2.20 time: 0.633737 Dec 16 14:40:00.469002 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 42/72] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:39:59 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1407 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:40:00.613486 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4498a766-a18c-45c7-a172-523159f3a015 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:00.630368 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4498a766-a18c-45c7-a172-523159f3a015 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 0.507648 Dec 16 14:40:00.633318 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 31/73] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:00 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:01.135836 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d1b6a33e-0b23-4eaa-89a4-3d258cd4d024 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:01.138351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d1b6a33e-0b23-4eaa-89a4-3d258cd4d024 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:01.155819 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d1b6a33e-0b23-4eaa-89a4-3d258cd4d024 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:01.158412 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d1b6a33e-0b23-4eaa-89a4-3d258cd4d024 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:01.159508 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d1b6a33e-0b23-4eaa-89a4-3d258cd4d024 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:01.163345 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d1b6a33e-0b23-4eaa-89a4-3d258cd4d024 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:01.482844 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d1b6a33e-0b23-4eaa-89a4-3d258cd4d024 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:01.488232 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c8b48712-d91e-4e41-b02e-77fa4c824de6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:01.489610 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c8b48712-d91e-4e41-b02e-77fa4c824de6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:01.492397 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d1b6a33e-0b23-4eaa-89a4-3d258cd4d024 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.360911 Dec 16 14:40:01.497831 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 43/74] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:01 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:01.502082 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8b48712-d91e-4e41-b02e-77fa4c824de6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:01.503139 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8b48712-d91e-4e41-b02e-77fa4c824de6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:01.504451 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8b48712-d91e-4e41-b02e-77fa4c824de6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:01.505594 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8b48712-d91e-4e41-b02e-77fa4c824de6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:01.651559 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-172fd5da-6ab8-455f-8e5f-d4e0d68f990a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:01.652337 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-172fd5da-6ab8-455f-8e5f-d4e0d68f990a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:01.674002 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-172fd5da-6ab8-455f-8e5f-d4e0d68f990a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:01.679008 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-172fd5da-6ab8-455f-8e5f-d4e0d68f990a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:01.680528 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-172fd5da-6ab8-455f-8e5f-d4e0d68f990a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:01.682816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-172fd5da-6ab8-455f-8e5f-d4e0d68f990a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:01.804288 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c8b48712-d91e-4e41-b02e-77fa4c824de6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:01.833104 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c8b48712-d91e-4e41-b02e-77fa4c824de6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:01.836234 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c8b48712-d91e-4e41-b02e-77fa4c824de6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:01.838992 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c8b48712-d91e-4e41-b02e-77fa4c824de6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1407 microversion: 2.20 time: 0.355220 Dec 16 14:40:01.840699 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 32/75] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:40:01 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:40:01.988539 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-89b5e785-327b-49fc-b7bb-176a89062af5 req-f16d58fb-e6fa-41f5-b4dd-22b8c37fdfca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afaa3d8-bcc9-4473-807c-ea33c70e2d05", "name": "network-vif-plugged", "status": "completed", "tag": "33fce9f6-5ac0-4aa0-996a-ade01b65bda3"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:01.991003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:01.991003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:40:02.007552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-89b5e785-327b-49fc-b7bb-176a89062af5 req-f16d58fb-e6fa-41f5-b4dd-22b8c37fdfca service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:02.008542 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-89b5e785-327b-49fc-b7bb-176a89062af5 req-f16d58fb-e6fa-41f5-b4dd-22b8c37fdfca service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:02.029785 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-89b5e785-327b-49fc-b7bb-176a89062af5 req-f16d58fb-e6fa-41f5-b4dd-22b8c37fdfca service nova] Creating event network-vif-plugged:33fce9f6-5ac0-4aa0-996a-ade01b65bda3 for instance 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 on hv-cinder-82189 Dec 16 14:40:02.035067 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-89b5e785-327b-49fc-b7bb-176a89062af5 req-f16d58fb-e6fa-41f5-b4dd-22b8c37fdfca service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051531 Dec 16 14:40:02.036633 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 33/76] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:40:02.077382 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-172fd5da-6ab8-455f-8e5f-d4e0d68f990a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:02.096382 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-172fd5da-6ab8-455f-8e5f-d4e0d68f990a tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1315 microversion: 2.1 time: 0.450946 Dec 16 14:40:02.098048 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 44/77] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:01 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:02.516996 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ccc68c22-2ed4-4406-9acc-fc2432dcf432 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:02.518198 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ccc68c22-2ed4-4406-9acc-fc2432dcf432 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:02.544307 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ccc68c22-2ed4-4406-9acc-fc2432dcf432 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:02.545099 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ccc68c22-2ed4-4406-9acc-fc2432dcf432 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:02.546413 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ccc68c22-2ed4-4406-9acc-fc2432dcf432 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:02.547133 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ccc68c22-2ed4-4406-9acc-fc2432dcf432 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:02.857882 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-57943184-4f76-4861-abec-ec320a27871c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:02.859855 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-57943184-4f76-4861-abec-ec320a27871c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:02.873198 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-57943184-4f76-4861-abec-ec320a27871c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:02.874278 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-57943184-4f76-4861-abec-ec320a27871c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:02.875273 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-57943184-4f76-4861-abec-ec320a27871c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:02.879089 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-57943184-4f76-4861-abec-ec320a27871c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:02.944350 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ccc68c22-2ed4-4406-9acc-fc2432dcf432 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:02.960023 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ccc68c22-2ed4-4406-9acc-fc2432dcf432 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.449829 Dec 16 14:40:02.961976 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 34/78] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:02 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:03.115259 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-531400f5-2224-4c0f-9d73-593acfbc7259 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:03.115934 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-531400f5-2224-4c0f-9d73-593acfbc7259 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:03.130373 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-531400f5-2224-4c0f-9d73-593acfbc7259 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:03.131082 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-531400f5-2224-4c0f-9d73-593acfbc7259 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:03.132209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-531400f5-2224-4c0f-9d73-593acfbc7259 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:03.133097 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-531400f5-2224-4c0f-9d73-593acfbc7259 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:03.311061 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-57943184-4f76-4861-abec-ec320a27871c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:03.323956 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-57943184-4f76-4861-abec-ec320a27871c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:03.325671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-57943184-4f76-4861-abec-ec320a27871c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:03.326837 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-57943184-4f76-4861-abec-ec320a27871c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1407 microversion: 2.20 time: 0.472630 Dec 16 14:40:03.340828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 45/79] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:40:02 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:40:03.502895 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-531400f5-2224-4c0f-9d73-593acfbc7259 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:03.513375 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-531400f5-2224-4c0f-9d73-593acfbc7259 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1502 microversion: 2.1 time: 0.402693 Dec 16 14:40:03.514706 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 35/80] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:03 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1502 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:03.978547 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f3010e3a-2c2c-4de3-bf41-c2bcbd4098c8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:03.979108 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f3010e3a-2c2c-4de3-bf41-c2bcbd4098c8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:03.991236 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3010e3a-2c2c-4de3-bf41-c2bcbd4098c8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:03.991698 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3010e3a-2c2c-4de3-bf41-c2bcbd4098c8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:03.992490 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3010e3a-2c2c-4de3-bf41-c2bcbd4098c8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:04.002525 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3010e3a-2c2c-4de3-bf41-c2bcbd4098c8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:04.072324 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-1f285853-0871-433d-9bc5-495f9a3b4054 req-690b4606-c3b1-42e6-a145-61ec8eff978b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d89b92-839c-4c63-ae4d-71c0a98797ea", "name": "network-vif-plugged", "status": "completed", "tag": "9f4e36fb-6721-4f46-ae0e-4c3561ce55f0"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:04.074152 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:04.074152 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:40:04.096391 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-1f285853-0871-433d-9bc5-495f9a3b4054 req-690b4606-c3b1-42e6-a145-61ec8eff978b service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:04.097147 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-1f285853-0871-433d-9bc5-495f9a3b4054 req-690b4606-c3b1-42e6-a145-61ec8eff978b service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:04.176719 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-1f285853-0871-433d-9bc5-495f9a3b4054 req-690b4606-c3b1-42e6-a145-61ec8eff978b service nova] Creating event network-vif-plugged:9f4e36fb-6721-4f46-ae0e-4c3561ce55f0 for instance 55d89b92-839c-4c63-ae4d-71c0a98797ea on hv-cinder-82189 Dec 16 14:40:04.195694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-1f285853-0871-433d-9bc5-495f9a3b4054 req-690b4606-c3b1-42e6-a145-61ec8eff978b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125691 Dec 16 14:40:04.198795 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 36/81] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:40:04.348915 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8bfbcd46-1d82-48a0-aec9-d3aeb2a883d0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:04.350744 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8bfbcd46-1d82-48a0-aec9-d3aeb2a883d0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:04.375547 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8bfbcd46-1d82-48a0-aec9-d3aeb2a883d0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:04.375961 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8bfbcd46-1d82-48a0-aec9-d3aeb2a883d0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:04.384405 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8bfbcd46-1d82-48a0-aec9-d3aeb2a883d0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:04.384886 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8bfbcd46-1d82-48a0-aec9-d3aeb2a883d0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:04.748174 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f3010e3a-2c2c-4de3-bf41-c2bcbd4098c8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:04.760738 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f3010e3a-2c2c-4de3-bf41-c2bcbd4098c8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.785967 Dec 16 14:40:04.761864 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 46/82] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:03 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:04.921544 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8bfbcd46-1d82-48a0-aec9-d3aeb2a883d0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:04.939451 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8bfbcd46-1d82-48a0-aec9-d3aeb2a883d0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:04.943097 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8bfbcd46-1d82-48a0-aec9-d3aeb2a883d0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:04.946056 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8bfbcd46-1d82-48a0-aec9-d3aeb2a883d0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1407 microversion: 2.20 time: 0.604954 Dec 16 14:40:04.949194 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 37/83] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:40:04 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1407 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:40:05.713859 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4c515ce9-f899-4403-a238-9b263967bd63 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c525891e-4f28-4a06-a3d4-a234ace1c11f"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:05.715674 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4c515ce9-f899-4403-a238-9b263967bd63 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:05.725287 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c515ce9-f899-4403-a238-9b263967bd63 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:05.726105 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c515ce9-f899-4403-a238-9b263967bd63 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:05.727529 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c515ce9-f899-4403-a238-9b263967bd63 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:05.728320 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c515ce9-f899-4403-a238-9b263967bd63 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:05.787602 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-57ef9e18-feff-4897-aa28-ec13260c23c2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:05.792104 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-57ef9e18-feff-4897-aa28-ec13260c23c2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:05.832014 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-57ef9e18-feff-4897-aa28-ec13260c23c2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:05.833156 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-57ef9e18-feff-4897-aa28-ec13260c23c2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:05.837189 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-57ef9e18-feff-4897-aa28-ec13260c23c2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:05.841216 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-57ef9e18-feff-4897-aa28-ec13260c23c2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:06.378590 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-57ef9e18-feff-4897-aa28-ec13260c23c2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:06.393409 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-57ef9e18-feff-4897-aa28-ec13260c23c2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1322 microversion: 2.1 time: 0.617434 Dec 16 14:40:06.394635 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 38/84] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:05 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1322 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:06.408025 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-43f792fa-35dd-4cee-b687-289fac44b089 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:06.408648 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-43f792fa-35dd-4cee-b687-289fac44b089 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:06.420572 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43f792fa-35dd-4cee-b687-289fac44b089 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:06.421231 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43f792fa-35dd-4cee-b687-289fac44b089 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:06.422839 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43f792fa-35dd-4cee-b687-289fac44b089 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:06.423323 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43f792fa-35dd-4cee-b687-289fac44b089 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:06.477494 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4c515ce9-f899-4403-a238-9b263967bd63 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "POST /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767428 Dec 16 14:40:06.480308 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 47/85] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:40:05 2021] POST /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:06.928481 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-43f792fa-35dd-4cee-b687-289fac44b089 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:06.952377 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-43f792fa-35dd-4cee-b687-289fac44b089 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:06.962810 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-43f792fa-35dd-4cee-b687-289fac44b089 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:06.964178 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-43f792fa-35dd-4cee-b687-289fac44b089 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1407 microversion: 2.20 time: 0.568356 Dec 16 14:40:06.965230 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 39/86] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:40:06 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1407 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:40:07.413336 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b85bf74a-e6a2-4b90-bccd-7f6a4b3548f1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:07.415706 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b85bf74a-e6a2-4b90-bccd-7f6a4b3548f1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:07.426165 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b85bf74a-e6a2-4b90-bccd-7f6a4b3548f1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:07.426849 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b85bf74a-e6a2-4b90-bccd-7f6a4b3548f1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:07.427742 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b85bf74a-e6a2-4b90-bccd-7f6a4b3548f1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:07.428477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b85bf74a-e6a2-4b90-bccd-7f6a4b3548f1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:07.897298 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b85bf74a-e6a2-4b90-bccd-7f6a4b3548f1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:07.909278 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b85bf74a-e6a2-4b90-bccd-7f6a4b3548f1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1517 microversion: 2.1 time: 0.500603 Dec 16 14:40:07.910649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 48/87] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:07 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1517 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:07.930463 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c6a325db-d0f7-4709-b7ce-31f2f85a7466 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:07.932573 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c6a325db-d0f7-4709-b7ce-31f2f85a7466 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:07.948775 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6a325db-d0f7-4709-b7ce-31f2f85a7466 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:07.949526 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6a325db-d0f7-4709-b7ce-31f2f85a7466 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:07.950503 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6a325db-d0f7-4709-b7ce-31f2f85a7466 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:07.951131 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6a325db-d0f7-4709-b7ce-31f2f85a7466 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:07.981794 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b94174f9-8b54-48af-b935-86b9b71ebbae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:07.982890 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b94174f9-8b54-48af-b935-86b9b71ebbae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:07.991970 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b94174f9-8b54-48af-b935-86b9b71ebbae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:07.992459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b94174f9-8b54-48af-b935-86b9b71ebbae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:07.993837 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b94174f9-8b54-48af-b935-86b9b71ebbae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:07.994264 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b94174f9-8b54-48af-b935-86b9b71ebbae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:08.128482 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-c6a325db-d0f7-4709-b7ce-31f2f85a7466 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lazy-loading 'flavor' on Instance uuid 55d89b92-839c-4c63-ae4d-71c0a98797ea {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:40:08.360697 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c6a325db-d0f7-4709-b7ce-31f2f85a7466 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "POST /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea/action" status: 200 len: 32 microversion: 2.1 time: 0.434075 Dec 16 14:40:08.365529 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 40/88] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:07 2021] POST /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea/action => generated 32 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:40:08.386650 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-1d57f654-0fdc-4a92-a598-3e667b03db6c req-948bed6d-e457-42cd-8bd8-bd8dec7cf16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e7a3c6-dc99-4927-83c2-dd8ba87239b2", "name": "network-vif-plugged", "status": "completed", "tag": "3086416d-8f44-45e7-a877-073ca8530605"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:08.388943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:08.388943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:40:08.399861 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-1d57f654-0fdc-4a92-a598-3e667b03db6c req-948bed6d-e457-42cd-8bd8-bd8dec7cf16c service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:08.400602 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-1d57f654-0fdc-4a92-a598-3e667b03db6c req-948bed6d-e457-42cd-8bd8-bd8dec7cf16c service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:08.412542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b94174f9-8b54-48af-b935-86b9b71ebbae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:08.433752 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b94174f9-8b54-48af-b935-86b9b71ebbae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:08.436717 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b94174f9-8b54-48af-b935-86b9b71ebbae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:08.438243 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b94174f9-8b54-48af-b935-86b9b71ebbae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1407 microversion: 2.20 time: 0.460253 Dec 16 14:40:08.439480 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 49/89] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:40:07 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:40:08.445808 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-cf874f10-828a-46c2-9728-4221953148b0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:08.446966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-cf874f10-828a-46c2-9728-4221953148b0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:08.449518 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-1d57f654-0fdc-4a92-a598-3e667b03db6c req-948bed6d-e457-42cd-8bd8-bd8dec7cf16c service nova] Creating event network-vif-plugged:3086416d-8f44-45e7-a877-073ca8530605 for instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 on hv-cinder-82189 Dec 16 14:40:08.454834 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf874f10-828a-46c2-9728-4221953148b0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:08.455464 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf874f10-828a-46c2-9728-4221953148b0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:08.456248 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf874f10-828a-46c2-9728-4221953148b0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:08.456682 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf874f10-828a-46c2-9728-4221953148b0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:08.466380 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-1d57f654-0fdc-4a92-a598-3e667b03db6c req-948bed6d-e457-42cd-8bd8-bd8dec7cf16c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099004 Dec 16 14:40:08.467000 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 41/90] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:08.778537 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-cf874f10-828a-46c2-9728-4221953148b0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:08.787110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-cf874f10-828a-46c2-9728-4221953148b0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.346295 Dec 16 14:40:08.801224 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 50/91] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:08 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:09.458486 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-78a07926-c21a-4fd2-a5a5-4219a30e98a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:09.459330 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-78a07926-c21a-4fd2-a5a5-4219a30e98a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:09.477283 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-78a07926-c21a-4fd2-a5a5-4219a30e98a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:09.478623 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-78a07926-c21a-4fd2-a5a5-4219a30e98a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:09.483665 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-78a07926-c21a-4fd2-a5a5-4219a30e98a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:09.485029 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-78a07926-c21a-4fd2-a5a5-4219a30e98a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:09.809912 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f2a759ac-3751-4178-9a2e-5c1092d4c38d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:09.820150 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f2a759ac-3751-4178-9a2e-5c1092d4c38d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:09.841091 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f2a759ac-3751-4178-9a2e-5c1092d4c38d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:09.841330 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f2a759ac-3751-4178-9a2e-5c1092d4c38d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:09.842396 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f2a759ac-3751-4178-9a2e-5c1092d4c38d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:09.842984 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f2a759ac-3751-4178-9a2e-5c1092d4c38d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:09.950038 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-78a07926-c21a-4fd2-a5a5-4219a30e98a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:09.958961 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-78a07926-c21a-4fd2-a5a5-4219a30e98a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:09.965279 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-78a07926-c21a-4fd2-a5a5-4219a30e98a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:09.979397 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-78a07926-c21a-4fd2-a5a5-4219a30e98a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1407 microversion: 2.20 time: 0.527043 Dec 16 14:40:09.981670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 42/92] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:40:09 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1407 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:40:10.218228 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f2a759ac-3751-4178-9a2e-5c1092d4c38d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:10.230069 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f2a759ac-3751-4178-9a2e-5c1092d4c38d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.426539 Dec 16 14:40:10.230910 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 51/93] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:09 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:10.996931 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f5f70087-35cc-4818-88c4-0ea7c2040a14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:10.998525 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f5f70087-35cc-4818-88c4-0ea7c2040a14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:11.007645 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f5f70087-35cc-4818-88c4-0ea7c2040a14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:11.008229 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f5f70087-35cc-4818-88c4-0ea7c2040a14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:11.009181 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f5f70087-35cc-4818-88c4-0ea7c2040a14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:11.009712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f5f70087-35cc-4818-88c4-0ea7c2040a14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:11.249440 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-dbfdefe7-2572-43d2-9c67-635e96375a1e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:11.249869 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-dbfdefe7-2572-43d2-9c67-635e96375a1e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:11.260415 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f5f70087-35cc-4818-88c4-0ea7c2040a14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:11.265635 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dbfdefe7-2572-43d2-9c67-635e96375a1e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:11.266527 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dbfdefe7-2572-43d2-9c67-635e96375a1e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:11.269492 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dbfdefe7-2572-43d2-9c67-635e96375a1e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:11.270943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f5f70087-35cc-4818-88c4-0ea7c2040a14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:11.271585 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dbfdefe7-2572-43d2-9c67-635e96375a1e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:11.273744 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f5f70087-35cc-4818-88c4-0ea7c2040a14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:11.275954 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f5f70087-35cc-4818-88c4-0ea7c2040a14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1599 microversion: 2.20 time: 0.283281 Dec 16 14:40:11.277063 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 43/94] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:40:10 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1599 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:40:11.297628 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-96559d08-84c4-4433-aebd-d1e616e05410 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:11.298461 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-96559d08-84c4-4433-aebd-d1e616e05410 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:11.308063 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-96559d08-84c4-4433-aebd-d1e616e05410 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:11.309722 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-96559d08-84c4-4433-aebd-d1e616e05410 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:11.311078 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-96559d08-84c4-4433-aebd-d1e616e05410 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:11.311710 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-96559d08-84c4-4433-aebd-d1e616e05410 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:11.560455 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-96559d08-84c4-4433-aebd-d1e616e05410 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.270160 Dec 16 14:40:11.561095 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 44/95] 10.222.0.64 () {60 vars in 1315 bytes} [Thu Dec 16 14:40:11 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:40:11.625527 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-dbfdefe7-2572-43d2-9c67-635e96375a1e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:11.635600 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-dbfdefe7-2572-43d2-9c67-635e96375a1e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.390838 Dec 16 14:40:11.636769 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 52/96] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:11 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:12.661590 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fed2a5d3-3231-4354-b393-68ccde3603fa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:12.663066 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fed2a5d3-3231-4354-b393-68ccde3603fa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:12.671788 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fed2a5d3-3231-4354-b393-68ccde3603fa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:12.673066 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fed2a5d3-3231-4354-b393-68ccde3603fa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:12.674271 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fed2a5d3-3231-4354-b393-68ccde3603fa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:12.674935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fed2a5d3-3231-4354-b393-68ccde3603fa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:13.096040 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fed2a5d3-3231-4354-b393-68ccde3603fa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:13.106014 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fed2a5d3-3231-4354-b393-68ccde3603fa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.448372 Dec 16 14:40:13.106608 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 45/97] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:12 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:13.729348 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-341bf71b-6e16-4448-9fe0-848c33d68380 req-87f2ba92-e691-40c3-8d42-44d24c8f133e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e7a3c6-dc99-4927-83c2-dd8ba87239b2", "tag": "3086416d-8f44-45e7-a877-073ca8530605"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:13.734110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-98ed01f6-162c-49f8-b6f9-10e3b8b6e681 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:13.734871 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:13.734871 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:40:13.736488 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-98ed01f6-162c-49f8-b6f9-10e3b8b6e681 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:13.755568 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-341bf71b-6e16-4448-9fe0-848c33d68380 req-87f2ba92-e691-40c3-8d42-44d24c8f133e service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:13.758318 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-98ed01f6-162c-49f8-b6f9-10e3b8b6e681 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:13.759634 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-341bf71b-6e16-4448-9fe0-848c33d68380 req-87f2ba92-e691-40c3-8d42-44d24c8f133e service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:13.761217 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-98ed01f6-162c-49f8-b6f9-10e3b8b6e681 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:13.763389 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-98ed01f6-162c-49f8-b6f9-10e3b8b6e681 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:13.765024 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-98ed01f6-162c-49f8-b6f9-10e3b8b6e681 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:13.799182 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-341bf71b-6e16-4448-9fe0-848c33d68380 req-87f2ba92-e691-40c3-8d42-44d24c8f133e service nova] Creating event network-changed:3086416d-8f44-45e7-a877-073ca8530605 for instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 on hv-cinder-82189 Dec 16 14:40:13.811183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-341bf71b-6e16-4448-9fe0-848c33d68380 req-87f2ba92-e691-40c3-8d42-44d24c8f133e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085540 Dec 16 14:40:13.812211 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 46/98] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:40:13.949530 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-98ed01f6-162c-49f8-b6f9-10e3b8b6e681 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 14 microversion: 2.20 time: 0.229485 Dec 16 14:40:13.950159 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 53/99] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:13 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:14.131598 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-306d8e9f-16dc-4853-b296-8d587f19e17b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:14.132661 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-306d8e9f-16dc-4853-b296-8d587f19e17b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:14.151321 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-306d8e9f-16dc-4853-b296-8d587f19e17b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:14.152178 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-306d8e9f-16dc-4853-b296-8d587f19e17b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:14.161511 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-306d8e9f-16dc-4853-b296-8d587f19e17b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:14.162336 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-306d8e9f-16dc-4853-b296-8d587f19e17b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:14.629201 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-306d8e9f-16dc-4853-b296-8d587f19e17b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:14.644580 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-306d8e9f-16dc-4853-b296-8d587f19e17b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.517148 Dec 16 14:40:14.645805 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 47/100] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:14 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:14.982832 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8ba3adbe-fae1-463d-9343-489ddb5adb03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:14.986757 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8ba3adbe-fae1-463d-9343-489ddb5adb03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:15.019041 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ba3adbe-fae1-463d-9343-489ddb5adb03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:15.020405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ba3adbe-fae1-463d-9343-489ddb5adb03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:15.021487 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ba3adbe-fae1-463d-9343-489ddb5adb03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:15.022139 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ba3adbe-fae1-463d-9343-489ddb5adb03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:15.261432 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8ba3adbe-fae1-463d-9343-489ddb5adb03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 14 microversion: 2.20 time: 0.305084 Dec 16 14:40:15.264734 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 54/101] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:14 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 14 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:15.663162 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-43e6ed71-8c1c-4b89-aa14-ded57bbf283f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:15.665700 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-43e6ed71-8c1c-4b89-aa14-ded57bbf283f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:15.696891 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43e6ed71-8c1c-4b89-aa14-ded57bbf283f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:15.699550 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43e6ed71-8c1c-4b89-aa14-ded57bbf283f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:15.702026 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43e6ed71-8c1c-4b89-aa14-ded57bbf283f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:15.706185 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43e6ed71-8c1c-4b89-aa14-ded57bbf283f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:16.275950 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-017e7ea1-d980-40e5-81f6-b9a8ea2ba0ca tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:16.277416 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-017e7ea1-d980-40e5-81f6-b9a8ea2ba0ca tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:16.295271 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-017e7ea1-d980-40e5-81f6-b9a8ea2ba0ca tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:16.297395 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-017e7ea1-d980-40e5-81f6-b9a8ea2ba0ca tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:16.298509 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-017e7ea1-d980-40e5-81f6-b9a8ea2ba0ca tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:16.302344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-017e7ea1-d980-40e5-81f6-b9a8ea2ba0ca tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:16.329200 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-43e6ed71-8c1c-4b89-aa14-ded57bbf283f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:16.341180 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-43e6ed71-8c1c-4b89-aa14-ded57bbf283f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.682375 Dec 16 14:40:16.349548 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 48/102] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:15 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:16.493076 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-017e7ea1-d980-40e5-81f6-b9a8ea2ba0ca tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 14 microversion: 2.20 time: 0.222121 Dec 16 14:40:16.493728 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 55/103] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:16 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 14 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:16.673849 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-76825f7e-d10c-40cd-a338-cf6a13dce0b7 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:16.676642 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-76825f7e-d10c-40cd-a338-cf6a13dce0b7 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:16.702707 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76825f7e-d10c-40cd-a338-cf6a13dce0b7 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:16.703301 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76825f7e-d10c-40cd-a338-cf6a13dce0b7 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:16.704556 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76825f7e-d10c-40cd-a338-cf6a13dce0b7 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:16.705280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76825f7e-d10c-40cd-a338-cf6a13dce0b7 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:16.782270 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-76825f7e-d10c-40cd-a338-cf6a13dce0b7 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:40:16.931480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-76825f7e-d10c-40cd-a338-cf6a13dce0b7 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 204 len: 0 microversion: 2.1 time: 0.260646 Dec 16 14:40:16.932676 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 49/104] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:40:16 2021] DELETE /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:40:16.944584 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7dc9dc16-60b5-4e13-af61-f2d3631a4034 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:16.945359 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7dc9dc16-60b5-4e13-af61-f2d3631a4034 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:16.953940 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7dc9dc16-60b5-4e13-af61-f2d3631a4034 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:16.954383 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7dc9dc16-60b5-4e13-af61-f2d3631a4034 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:16.955404 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7dc9dc16-60b5-4e13-af61-f2d3631a4034 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:16.955839 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7dc9dc16-60b5-4e13-af61-f2d3631a4034 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:17.233908 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7dc9dc16-60b5-4e13-af61-f2d3631a4034 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:17.254270 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7dc9dc16-60b5-4e13-af61-f2d3631a4034 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1554 microversion: 2.1 time: 0.314842 Dec 16 14:40:17.254856 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 56/105] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:16 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1554 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:17.360436 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-11bd2d7c-58ff-426d-8047-93e0788f2180 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:17.362211 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-11bd2d7c-58ff-426d-8047-93e0788f2180 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:17.372922 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-11bd2d7c-58ff-426d-8047-93e0788f2180 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:17.373585 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-11bd2d7c-58ff-426d-8047-93e0788f2180 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:17.374798 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-11bd2d7c-58ff-426d-8047-93e0788f2180 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:17.375403 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-11bd2d7c-58ff-426d-8047-93e0788f2180 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:17.506745 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8ae9da23-d758-48bc-a618-bd6277cddc96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:17.508263 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8ae9da23-d758-48bc-a618-bd6277cddc96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:17.521883 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ae9da23-d758-48bc-a618-bd6277cddc96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:17.523084 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ae9da23-d758-48bc-a618-bd6277cddc96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:17.525345 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ae9da23-d758-48bc-a618-bd6277cddc96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:17.526553 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ae9da23-d758-48bc-a618-bd6277cddc96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:17.645842 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-11bd2d7c-58ff-426d-8047-93e0788f2180 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:17.657113 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-11bd2d7c-58ff-426d-8047-93e0788f2180 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.301079 Dec 16 14:40:17.658526 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 50/106] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:17 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:17.709018 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8ae9da23-d758-48bc-a618-bd6277cddc96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 14 microversion: 2.20 time: 0.207877 Dec 16 14:40:17.713732 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 57/107] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:17 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:18.273771 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2c2f34e3-4b62-4a5d-b42c-e3b64db7dd17 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:18.273771 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2c2f34e3-4b62-4a5d-b42c-e3b64db7dd17 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:18.280216 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2c2f34e3-4b62-4a5d-b42c-e3b64db7dd17 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:18.280661 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2c2f34e3-4b62-4a5d-b42c-e3b64db7dd17 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:18.281455 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2c2f34e3-4b62-4a5d-b42c-e3b64db7dd17 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:18.281890 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2c2f34e3-4b62-4a5d-b42c-e3b64db7dd17 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:18.541935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2c2f34e3-4b62-4a5d-b42c-e3b64db7dd17 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:18.555935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2c2f34e3-4b62-4a5d-b42c-e3b64db7dd17 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1554 microversion: 2.1 time: 0.287594 Dec 16 14:40:18.556762 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 51/108] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:18 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1554 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:18.677416 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7e846198-12d4-48a1-ad1c-994a0b39fdf2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:18.678126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7e846198-12d4-48a1-ad1c-994a0b39fdf2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:18.688972 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7e846198-12d4-48a1-ad1c-994a0b39fdf2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:18.689303 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7e846198-12d4-48a1-ad1c-994a0b39fdf2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:18.690097 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7e846198-12d4-48a1-ad1c-994a0b39fdf2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:18.690560 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7e846198-12d4-48a1-ad1c-994a0b39fdf2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:18.726259 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3bf0f74b-9655-41cb-847a-bac12422f667 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:18.729727 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3bf0f74b-9655-41cb-847a-bac12422f667 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:18.740476 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3bf0f74b-9655-41cb-847a-bac12422f667 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:18.741797 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3bf0f74b-9655-41cb-847a-bac12422f667 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:18.743615 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3bf0f74b-9655-41cb-847a-bac12422f667 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:18.744279 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3bf0f74b-9655-41cb-847a-bac12422f667 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:18.972699 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7e846198-12d4-48a1-ad1c-994a0b39fdf2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:18.990522 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7e846198-12d4-48a1-ad1c-994a0b39fdf2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.316750 Dec 16 14:40:18.991522 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 58/109] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:18 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:19.573715 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-619b9fab-7435-4c8e-a91b-b7db2e0973bc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:19.574574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-619b9fab-7435-4c8e-a91b-b7db2e0973bc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:19.582489 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-619b9fab-7435-4c8e-a91b-b7db2e0973bc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:19.583226 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-619b9fab-7435-4c8e-a91b-b7db2e0973bc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:19.588359 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-619b9fab-7435-4c8e-a91b-b7db2e0973bc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:19.588671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-619b9fab-7435-4c8e-a91b-b7db2e0973bc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:19.819466 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-619b9fab-7435-4c8e-a91b-b7db2e0973bc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:19.844182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-619b9fab-7435-4c8e-a91b-b7db2e0973bc tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1554 microversion: 2.1 time: 0.274870 Dec 16 14:40:19.845791 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 59/110] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:19 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:20.009449 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-38ce1c9c-5523-47d7-bd87-175a72b9d05e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:20.010357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-38ce1c9c-5523-47d7-bd87-175a72b9d05e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:20.019618 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-38ce1c9c-5523-47d7-bd87-175a72b9d05e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.020300 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-38ce1c9c-5523-47d7-bd87-175a72b9d05e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:20.021627 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-38ce1c9c-5523-47d7-bd87-175a72b9d05e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.022211 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-38ce1c9c-5523-47d7-bd87-175a72b9d05e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:20.268821 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-38ce1c9c-5523-47d7-bd87-175a72b9d05e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:20.288689 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-38ce1c9c-5523-47d7-bd87-175a72b9d05e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.283800 Dec 16 14:40:20.305926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 60/111] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:20 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:20.866130 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a08c030f-2236-4cad-bfe8-e23a0059ac75 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:20.866967 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a08c030f-2236-4cad-bfe8-e23a0059ac75 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:20.885196 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a08c030f-2236-4cad-bfe8-e23a0059ac75 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.885655 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a08c030f-2236-4cad-bfe8-e23a0059ac75 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:20.887314 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a08c030f-2236-4cad-bfe8-e23a0059ac75 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:20.887755 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a08c030f-2236-4cad-bfe8-e23a0059ac75 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:21.131046 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a08c030f-2236-4cad-bfe8-e23a0059ac75 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:21.142012 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a08c030f-2236-4cad-bfe8-e23a0059ac75 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1554 microversion: 2.1 time: 0.282806 Dec 16 14:40:21.143069 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 61/112] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:20 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1554 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:21.314027 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4b26a044-3466-41f0-98d1-3c63b039d34d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:21.314931 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4b26a044-3466-41f0-98d1-3c63b039d34d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:21.323337 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4b26a044-3466-41f0-98d1-3c63b039d34d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:21.323792 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4b26a044-3466-41f0-98d1-3c63b039d34d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:21.324582 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4b26a044-3466-41f0-98d1-3c63b039d34d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:21.325060 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4b26a044-3466-41f0-98d1-3c63b039d34d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:21.355828 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3bf0f74b-9655-41cb-847a-bac12422f667 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 14 microversion: 2.20 time: 2.637882 Dec 16 14:40:21.360858 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 52/113] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:18 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 14 bytes in 2644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:21.566635 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4b26a044-3466-41f0-98d1-3c63b039d34d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:21.579466 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4b26a044-3466-41f0-98d1-3c63b039d34d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.269179 Dec 16 14:40:21.589568 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 62/114] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:21 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:22.161341 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-bcfcb913-0e05-4082-85ff-d177bbce81bf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:22.162045 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-bcfcb913-0e05-4082-85ff-d177bbce81bf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:22.171347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bcfcb913-0e05-4082-85ff-d177bbce81bf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:22.171783 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bcfcb913-0e05-4082-85ff-d177bbce81bf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.172558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bcfcb913-0e05-4082-85ff-d177bbce81bf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:22.173017 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bcfcb913-0e05-4082-85ff-d177bbce81bf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.368252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-08e97e93-aa63-43eb-aaaf-6638bedaba9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:22.369592 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-08e97e93-aa63-43eb-aaaf-6638bedaba9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:22.383620 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-08e97e93-aa63-43eb-aaaf-6638bedaba9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:22.384334 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-08e97e93-aa63-43eb-aaaf-6638bedaba9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.385395 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-08e97e93-aa63-43eb-aaaf-6638bedaba9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:22.385901 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-08e97e93-aa63-43eb-aaaf-6638bedaba9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.527685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-08e97e93-aa63-43eb-aaaf-6638bedaba9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 14 microversion: 2.20 time: 0.163463 Dec 16 14:40:22.531000 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 63/115] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:22 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:22.600117 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a90d2ca7-41d9-45a3-aebe-faaed4025a59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:22.602246 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a90d2ca7-41d9-45a3-aebe-faaed4025a59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:22.609099 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a90d2ca7-41d9-45a3-aebe-faaed4025a59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:22.609992 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a90d2ca7-41d9-45a3-aebe-faaed4025a59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.611274 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a90d2ca7-41d9-45a3-aebe-faaed4025a59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:22.611872 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a90d2ca7-41d9-45a3-aebe-faaed4025a59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:22.703145 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-bcfcb913-0e05-4082-85ff-d177bbce81bf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:22.714788 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-bcfcb913-0e05-4082-85ff-d177bbce81bf tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1554 microversion: 2.1 time: 0.557685 Dec 16 14:40:22.715363 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 53/116] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:22 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1554 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:23.274232 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a90d2ca7-41d9-45a3-aebe-faaed4025a59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:23.285408 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a90d2ca7-41d9-45a3-aebe-faaed4025a59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.689318 Dec 16 14:40:23.286489 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 64/117] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:22 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:23.539789 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a34758a1-2f1e-4bf3-96fa-06de73d99367 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:23.540404 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a34758a1-2f1e-4bf3-96fa-06de73d99367 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:23.569855 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a34758a1-2f1e-4bf3-96fa-06de73d99367 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.571376 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a34758a1-2f1e-4bf3-96fa-06de73d99367 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:23.572466 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a34758a1-2f1e-4bf3-96fa-06de73d99367 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.577991 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a34758a1-2f1e-4bf3-96fa-06de73d99367 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:23.732188 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bda7efac-e205-4a5d-b79d-2c9f78fceb00 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:23.733539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bda7efac-e205-4a5d-b79d-2c9f78fceb00 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:23.747840 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bda7efac-e205-4a5d-b79d-2c9f78fceb00 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.748295 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bda7efac-e205-4a5d-b79d-2c9f78fceb00 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:23.752128 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bda7efac-e205-4a5d-b79d-2c9f78fceb00 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.752582 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bda7efac-e205-4a5d-b79d-2c9f78fceb00 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:23.811295 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a34758a1-2f1e-4bf3-96fa-06de73d99367 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 14 microversion: 2.20 time: 0.276035 Dec 16 14:40:23.815325 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 54/118] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:23 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 14 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:23.842094 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-84fe23a1-2e20-4a06-b099-d8d56267d503 req-dabfa4aa-1558-44bc-8307-c6709c886c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e979fa-0671-444e-b47c-b9be04bd4bff", "name": "network-vif-deleted", "tag": "985f8d8b-5b76-4176-800e-423ef68a9aa2"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:23.850204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:23.850204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:40:23.861570 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-84fe23a1-2e20-4a06-b099-d8d56267d503 req-dabfa4aa-1558-44bc-8307-c6709c886c9c service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:23.863281 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-84fe23a1-2e20-4a06-b099-d8d56267d503 req-dabfa4aa-1558-44bc-8307-c6709c886c9c service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:23.886287 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-84fe23a1-2e20-4a06-b099-d8d56267d503 req-dabfa4aa-1558-44bc-8307-c6709c886c9c service nova] Creating event network-vif-deleted:985f8d8b-5b76-4176-800e-423ef68a9aa2 for instance d3e979fa-0671-444e-b47c-b9be04bd4bff on hv-cinder-82189 Dec 16 14:40:23.893660 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-84fe23a1-2e20-4a06-b099-d8d56267d503 req-dabfa4aa-1558-44bc-8307-c6709c886c9c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076056 Dec 16 14:40:23.895428 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 55/119] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:23.935681 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bda7efac-e205-4a5d-b79d-2c9f78fceb00 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:23.949661 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bda7efac-e205-4a5d-b79d-2c9f78fceb00 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1512 microversion: 2.1 time: 0.221498 Dec 16 14:40:23.950397 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 65/120] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:23 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:24.303643 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c69d035a-4fdb-49d7-b885-f713ddbd9541 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:24.304347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c69d035a-4fdb-49d7-b885-f713ddbd9541 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:24.315969 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c69d035a-4fdb-49d7-b885-f713ddbd9541 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:24.322850 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c69d035a-4fdb-49d7-b885-f713ddbd9541 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:24.324014 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c69d035a-4fdb-49d7-b885-f713ddbd9541 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:24.324483 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c69d035a-4fdb-49d7-b885-f713ddbd9541 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:24.572043 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c69d035a-4fdb-49d7-b885-f713ddbd9541 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:24.583226 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c69d035a-4fdb-49d7-b885-f713ddbd9541 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.283945 Dec 16 14:40:24.584063 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 56/121] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:24 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:24.823550 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c11ab5bc-589a-4107-a404-ce8aac898fd2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:24.824621 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c11ab5bc-589a-4107-a404-ce8aac898fd2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:24.859003 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c11ab5bc-589a-4107-a404-ce8aac898fd2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:24.859454 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c11ab5bc-589a-4107-a404-ce8aac898fd2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:24.861669 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c11ab5bc-589a-4107-a404-ce8aac898fd2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:24.862143 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c11ab5bc-589a-4107-a404-ce8aac898fd2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:24.970675 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:24.973345 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:24.982105 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:24.982930 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:24.983706 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:24.984138 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:25.037433 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c11ab5bc-589a-4107-a404-ce8aac898fd2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 14 microversion: 2.20 time: 0.218486 Dec 16 14:40:25.038432 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 66/122] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:24 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:25.066106 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:25.066566 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:25.067056 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lazy-loading 'fault' on Instance uuid d3e979fa-0671-444e-b47c-b9be04bd4bff {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:40:25.147694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8d3e42caae84fedb52ba42d8763ee91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6906ddb7ea8b4cde8dabbec416e0f996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:25.167249 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f7fe8bff-2e7c-400f-8ad2-175aee70830d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 200 len: 1351 microversion: 2.1 time: 0.200267 Dec 16 14:40:25.170408 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 57/123] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:24 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 1351 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:25.614948 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8b883255-23f3-4d93-91d4-68423d844bb3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:25.616481 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8b883255-23f3-4d93-91d4-68423d844bb3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:25.635114 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b883255-23f3-4d93-91d4-68423d844bb3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:25.636426 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b883255-23f3-4d93-91d4-68423d844bb3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:25.638134 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b883255-23f3-4d93-91d4-68423d844bb3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:25.639319 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b883255-23f3-4d93-91d4-68423d844bb3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:26.048920 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-eedeb83b-e1cc-40f5-beb9-a9cbdb0903b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:26.051336 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-eedeb83b-e1cc-40f5-beb9-a9cbdb0903b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:26.065004 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eedeb83b-e1cc-40f5-beb9-a9cbdb0903b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:26.065477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8b883255-23f3-4d93-91d4-68423d844bb3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:26.066149 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eedeb83b-e1cc-40f5-beb9-a9cbdb0903b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:26.067128 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eedeb83b-e1cc-40f5-beb9-a9cbdb0903b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:26.067708 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eedeb83b-e1cc-40f5-beb9-a9cbdb0903b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:26.076902 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8b883255-23f3-4d93-91d4-68423d844bb3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.470245 Dec 16 14:40:26.077545 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 67/124] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:25 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:26.186607 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8d3a7ee9-4cb0-4765-91cf-50879486361d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:26.187221 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8d3a7ee9-4cb0-4765-91cf-50879486361d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:26.194811 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8d3a7ee9-4cb0-4765-91cf-50879486361d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:26.195683 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8d3a7ee9-4cb0-4765-91cf-50879486361d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:26.196612 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8d3a7ee9-4cb0-4765-91cf-50879486361d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:26.197217 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8d3a7ee9-4cb0-4765-91cf-50879486361d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:26.212032 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-eedeb83b-e1cc-40f5-beb9-a9cbdb0903b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 1162 microversion: 2.20 time: 0.166392 Dec 16 14:40:26.216008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 58/125] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:26 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 1162 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:40:26.260921 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-8d3a7ee9-4cb0-4765-91cf-50879486361d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] HTTP exception thrown: Instance d3e979fa-0671-444e-b47c-b9be04bd4bff could not be found. Dec 16 14:40:26.261810 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8d3a7ee9-4cb0-4765-91cf-50879486361d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Returning 404 to user: Instance d3e979fa-0671-444e-b47c-b9be04bd4bff could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:40:26.263057 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8d3a7ee9-4cb0-4765-91cf-50879486361d tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 404 len: 111 microversion: 2.1 time: 0.079954 Dec 16 14:40:26.264476 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 68/126] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:26 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:40:26.481163 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-cab9ced6-4097-4d91-aa5d-5112d75ee842 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:26.482574 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-cab9ced6-4097-4d91-aa5d-5112d75ee842 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:26.491839 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cab9ced6-4097-4d91-aa5d-5112d75ee842 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:26.493414 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cab9ced6-4097-4d91-aa5d-5112d75ee842 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:26.494343 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cab9ced6-4097-4d91-aa5d-5112d75ee842 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:26.494987 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cab9ced6-4097-4d91-aa5d-5112d75ee842 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:26.544075 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-cab9ced6-4097-4d91-aa5d-5112d75ee842 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] HTTP exception thrown: Instance d3e979fa-0671-444e-b47c-b9be04bd4bff could not be found. Dec 16 14:40:26.544684 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-cab9ced6-4097-4d91-aa5d-5112d75ee842 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Returning 404 to user: Instance d3e979fa-0671-444e-b47c-b9be04bd4bff could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:40:26.545538 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-cab9ced6-4097-4d91-aa5d-5112d75ee842 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.069441 Dec 16 14:40:26.546257 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 59/127] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:40:26 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:40:27.095514 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-992a0cad-6f8a-4ff7-b05f-7ad88a5fafa8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:27.096380 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-992a0cad-6f8a-4ff7-b05f-7ad88a5fafa8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:27.106694 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-992a0cad-6f8a-4ff7-b05f-7ad88a5fafa8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.107425 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-992a0cad-6f8a-4ff7-b05f-7ad88a5fafa8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.108501 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-992a0cad-6f8a-4ff7-b05f-7ad88a5fafa8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.109109 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-992a0cad-6f8a-4ff7-b05f-7ad88a5fafa8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.224074 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3d272d81-a3b5-434e-b71e-4c2e1bb020d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:27.225166 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3d272d81-a3b5-434e-b71e-4c2e1bb020d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:27.243155 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d272d81-a3b5-434e-b71e-4c2e1bb020d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.243738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d272d81-a3b5-434e-b71e-4c2e1bb020d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.244941 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d272d81-a3b5-434e-b71e-4c2e1bb020d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.245528 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d272d81-a3b5-434e-b71e-4c2e1bb020d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.389577 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-992a0cad-6f8a-4ff7-b05f-7ad88a5fafa8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:27.403093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-992a0cad-6f8a-4ff7-b05f-7ad88a5fafa8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.311891 Dec 16 14:40:27.405176 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 69/128] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:27 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:27.412640 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3d272d81-a3b5-434e-b71e-4c2e1bb020d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 11371 microversion: 2.20 time: 0.192281 Dec 16 14:40:27.414652 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 60/129] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:27 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 11371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:27.975010 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d1e004b9-9265-463d-9fd0-4c9754492e64 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:27.975740 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d1e004b9-9265-463d-9fd0-4c9754492e64 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:27.983548 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d1e004b9-9265-463d-9fd0-4c9754492e64 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.984258 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d1e004b9-9265-463d-9fd0-4c9754492e64 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:27.985325 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d1e004b9-9265-463d-9fd0-4c9754492e64 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:27.985964 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d1e004b9-9265-463d-9fd0-4c9754492e64 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.043112 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-d1e004b9-9265-463d-9fd0-4c9754492e64 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] HTTP exception thrown: Instance d3e979fa-0671-444e-b47c-b9be04bd4bff could not be found. Dec 16 14:40:28.044003 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d1e004b9-9265-463d-9fd0-4c9754492e64 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Returning 404 to user: Instance d3e979fa-0671-444e-b47c-b9be04bd4bff could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:40:28.045205 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d1e004b9-9265-463d-9fd0-4c9754492e64 tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 404 len: 111 microversion: 2.1 time: 0.074737 Dec 16 14:40:28.046294 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 70/130] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:40:27 2021] DELETE /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:40:28.055029 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-61c29a85-3e24-4b35-8cf4-b6de2f07d9fb tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:28.055879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-61c29a85-3e24-4b35-8cf4-b6de2f07d9fb tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] [instance: d3e979fa-0671-444e-b47c-b9be04bd4bff] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:28.064222 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61c29a85-3e24-4b35-8cf4-b6de2f07d9fb tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.065105 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61c29a85-3e24-4b35-8cf4-b6de2f07d9fb tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.066094 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61c29a85-3e24-4b35-8cf4-b6de2f07d9fb tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.066741 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61c29a85-3e24-4b35-8cf4-b6de2f07d9fb tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.139735 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-61c29a85-3e24-4b35-8cf4-b6de2f07d9fb tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] HTTP exception thrown: Instance d3e979fa-0671-444e-b47c-b9be04bd4bff could not be found. Dec 16 14:40:28.140990 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-61c29a85-3e24-4b35-8cf4-b6de2f07d9fb tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] Returning 404 to user: Instance d3e979fa-0671-444e-b47c-b9be04bd4bff could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:40:28.142021 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-61c29a85-3e24-4b35-8cf4-b6de2f07d9fb tempest-DeleteServersTestJSON-621198219 tempest-DeleteServersTestJSON-621198219-project] 10.222.0.64 "GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff" status: 404 len: 111 microversion: 2.1 time: 0.091828 Dec 16 14:40:28.142992 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 61/131] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:28 2021] GET /compute/v2.1/servers/d3e979fa-0671-444e-b47c-b9be04bd4bff => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:40:28.427318 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-03b08835-a9ce-46a4-9f5a-f431f55084e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:28.431457 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-467b0726-1fae-4974-a928-daf41cf3fb3d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:28.432758 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-03b08835-a9ce-46a4-9f5a-f431f55084e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:28.437079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-467b0726-1fae-4974-a928-daf41cf3fb3d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:28.447843 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-03b08835-a9ce-46a4-9f5a-f431f55084e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.448566 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-03b08835-a9ce-46a4-9f5a-f431f55084e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.451943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-467b0726-1fae-4974-a928-daf41cf3fb3d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.453223 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-03b08835-a9ce-46a4-9f5a-f431f55084e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.453904 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-03b08835-a9ce-46a4-9f5a-f431f55084e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.461548 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-467b0726-1fae-4974-a928-daf41cf3fb3d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.462919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-467b0726-1fae-4974-a928-daf41cf3fb3d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:28.463729 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-467b0726-1fae-4974-a928-daf41cf3fb3d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:28.689582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-467b0726-1fae-4974-a928-daf41cf3fb3d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 18155 microversion: 2.20 time: 0.265393 Dec 16 14:40:28.693834 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 62/132] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:28 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 18155 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:28.962847 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-03b08835-a9ce-46a4-9f5a-f431f55084e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:28.981452 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-03b08835-a9ce-46a4-9f5a-f431f55084e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.561013 Dec 16 14:40:28.982097 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 71/133] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:28 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:29.703183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ea0d8377-c3ed-49f9-a170-d23394e287a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:29.704861 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ea0d8377-c3ed-49f9-a170-d23394e287a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:29.720553 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ea0d8377-c3ed-49f9-a170-d23394e287a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:29.722341 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ea0d8377-c3ed-49f9-a170-d23394e287a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:29.723193 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ea0d8377-c3ed-49f9-a170-d23394e287a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:29.723636 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ea0d8377-c3ed-49f9-a170-d23394e287a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:29.935612 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ea0d8377-c3ed-49f9-a170-d23394e287a4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 19133 microversion: 2.20 time: 0.236793 Dec 16 14:40:29.936525 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 63/134] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:29 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 19133 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:29.999957 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9eab69a6-f3e8-429d-891c-768bab30d232 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:30.001314 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9eab69a6-f3e8-429d-891c-768bab30d232 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:30.027044 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9eab69a6-f3e8-429d-891c-768bab30d232 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:30.028890 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9eab69a6-f3e8-429d-891c-768bab30d232 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:30.031144 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9eab69a6-f3e8-429d-891c-768bab30d232 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:30.032950 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9eab69a6-f3e8-429d-891c-768bab30d232 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:30.549091 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9eab69a6-f3e8-429d-891c-768bab30d232 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:30.559902 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9eab69a6-f3e8-429d-891c-768bab30d232 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.564004 Dec 16 14:40:30.560112 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 72/135] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:29 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:30.956549 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1e76aec0-c31c-4b17-aded-812e29aba569 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:30.958946 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1e76aec0-c31c-4b17-aded-812e29aba569 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:30.970699 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1e76aec0-c31c-4b17-aded-812e29aba569 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:30.971881 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1e76aec0-c31c-4b17-aded-812e29aba569 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:30.972981 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1e76aec0-c31c-4b17-aded-812e29aba569 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:30.974073 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1e76aec0-c31c-4b17-aded-812e29aba569 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:31.186900 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1e76aec0-c31c-4b17-aded-812e29aba569 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 21614 microversion: 2.20 time: 0.241982 Dec 16 14:40:31.191325 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 64/136] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:30 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 21614 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:31.583438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-80b66fad-8d86-45b5-9c38-6804dd7c8e2a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:31.590931 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-80b66fad-8d86-45b5-9c38-6804dd7c8e2a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:31.624912 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-80b66fad-8d86-45b5-9c38-6804dd7c8e2a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:31.625637 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-80b66fad-8d86-45b5-9c38-6804dd7c8e2a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:31.627049 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-80b66fad-8d86-45b5-9c38-6804dd7c8e2a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:31.627796 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-80b66fad-8d86-45b5-9c38-6804dd7c8e2a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:31.951930 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-80b66fad-8d86-45b5-9c38-6804dd7c8e2a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:31.962384 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-80b66fad-8d86-45b5-9c38-6804dd7c8e2a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.388141 Dec 16 14:40:31.963278 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 73/137] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:31 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:32.200524 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3f044b80-3fdd-42b5-a788-253356eb42b3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:32.202296 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3f044b80-3fdd-42b5-a788-253356eb42b3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:32.213657 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3f044b80-3fdd-42b5-a788-253356eb42b3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:32.214817 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3f044b80-3fdd-42b5-a788-253356eb42b3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:32.215858 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3f044b80-3fdd-42b5-a788-253356eb42b3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:32.216458 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3f044b80-3fdd-42b5-a788-253356eb42b3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:32.370593 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3f044b80-3fdd-42b5-a788-253356eb42b3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 22981 microversion: 2.20 time: 0.174243 Dec 16 14:40:32.371237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 65/138] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:32 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 22981 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:32.980517 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2550e69b-4158-44d5-b733-1677fa64712a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:32.981517 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2550e69b-4158-44d5-b733-1677fa64712a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:32.997730 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2550e69b-4158-44d5-b733-1677fa64712a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:32.998449 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2550e69b-4158-44d5-b733-1677fa64712a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:32.999491 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2550e69b-4158-44d5-b733-1677fa64712a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:33.000074 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2550e69b-4158-44d5-b733-1677fa64712a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:33.392681 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b364d83b-0685-42ca-8c31-8e86b36fb4ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:33.399261 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b364d83b-0685-42ca-8c31-8e86b36fb4ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:33.440020 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b364d83b-0685-42ca-8c31-8e86b36fb4ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:33.441600 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b364d83b-0685-42ca-8c31-8e86b36fb4ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:33.443321 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b364d83b-0685-42ca-8c31-8e86b36fb4ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:33.444130 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b364d83b-0685-42ca-8c31-8e86b36fb4ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:33.588210 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2550e69b-4158-44d5-b733-1677fa64712a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:33.606185 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2550e69b-4158-44d5-b733-1677fa64712a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.630486 Dec 16 14:40:33.608256 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 74/139] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:32 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:33.770499 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b364d83b-0685-42ca-8c31-8e86b36fb4ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 24644 microversion: 2.20 time: 0.388922 Dec 16 14:40:33.772196 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 66/140] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:33 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 24644 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:34.628460 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-722bfc4a-a126-4431-af5f-598a52e40e10 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:34.629747 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-722bfc4a-a126-4431-af5f-598a52e40e10 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:34.664437 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-722bfc4a-a126-4431-af5f-598a52e40e10 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.665200 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-722bfc4a-a126-4431-af5f-598a52e40e10 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.666307 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-722bfc4a-a126-4431-af5f-598a52e40e10 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.667189 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-722bfc4a-a126-4431-af5f-598a52e40e10 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.787280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d9bad655-d89f-48f8-948a-ad118a595a53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:34.789155 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d9bad655-d89f-48f8-948a-ad118a595a53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:34.801878 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d9bad655-d89f-48f8-948a-ad118a595a53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.805052 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d9bad655-d89f-48f8-948a-ad118a595a53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:34.806960 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d9bad655-d89f-48f8-948a-ad118a595a53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:34.808226 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d9bad655-d89f-48f8-948a-ad118a595a53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:35.094786 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-722bfc4a-a126-4431-af5f-598a52e40e10 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:35.100498 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d9bad655-d89f-48f8-948a-ad118a595a53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 26192 microversion: 2.20 time: 0.316529 Dec 16 14:40:35.102035 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 67/141] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:34 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 26192 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:35.105127 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-722bfc4a-a126-4431-af5f-598a52e40e10 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.480571 Dec 16 14:40:35.109035 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 75/142] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:34 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:35.838763 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1356592553", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "networks": [{"uuid": "80a0dcd7-59dc-485e-9feb-7d18fa3c28f8"}]}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:35.966113 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] validate_networks() for [('80a0dcd7-59dc-485e-9feb-7d18fa3c28f8', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:40:36.114758 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-39638778-0edb-4606-9324-3c8e712cc4a1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:36.117259 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-39638778-0edb-4606-9324-3c8e712cc4a1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:36.135675 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-39638778-0edb-4606-9324-3c8e712cc4a1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:36.136009 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-39638778-0edb-4606-9324-3c8e712cc4a1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:36.136868 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-39638778-0edb-4606-9324-3c8e712cc4a1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:36.137426 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-39638778-0edb-4606-9324-3c8e712cc4a1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:36.324999 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-39638778-0edb-4606-9324-3c8e712cc4a1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 27041 microversion: 2.20 time: 0.215131 Dec 16 14:40:36.325925 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 76/143] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:36 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 27041 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:36.332288 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fb000bd0-cd71-446b-9c29-9fa66f807c61 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:36.333581 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fb000bd0-cd71-446b-9c29-9fa66f807c61 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:36.347674 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb000bd0-cd71-446b-9c29-9fa66f807c61 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:36.348546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb000bd0-cd71-446b-9c29-9fa66f807c61 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:36.349586 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb000bd0-cd71-446b-9c29-9fa66f807c61 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:36.350398 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb000bd0-cd71-446b-9c29-9fa66f807c61 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:36.723668 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:40:36.725012 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:40:36.725773 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:40:36.726375 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:40:36.726927 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:40:36.766971 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fb000bd0-cd71-446b-9c29-9fa66f807c61 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:36.767422 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:36.768436 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:36.771361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:36.772123 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:36.781344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fb000bd0-cd71-446b-9c29-9fa66f807c61 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.454080 Dec 16 14:40:36.784272 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 77/144] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:36 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:36.837772 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Getting quotas for project 5a10c6d1e7e7425bb59f6efad4231db3. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:40:36.843257 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Getting quotas for user eeb2dde456a8408d820d765c54f8a868 and project 5a10c6d1e7e7425bb59f6efad4231db3. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:40:36.865938 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:40:36.871166 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:40:36.954720 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e6847bb2-758f-4a51-9a7e-60b329b325c4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621150 Dec 16 14:40:36.955983 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 68/145] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:40:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:40:36.966973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-32655188-30a7-4b28-996f-b1d2ba5180b4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:36.967580 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-32655188-30a7-4b28-996f-b1d2ba5180b4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:37.055394 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-32655188-30a7-4b28-996f-b1d2ba5180b4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:37.066018 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-32655188-30a7-4b28-996f-b1d2ba5180b4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1218 microversion: 2.1 time: 0.103554 Dec 16 14:40:37.078436 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 78/146] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:36 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:37.343121 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d53d1ff5-5081-4bd8-ac94-58dfe91bccd0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:37.344270 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d53d1ff5-5081-4bd8-ac94-58dfe91bccd0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:37.357176 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d53d1ff5-5081-4bd8-ac94-58dfe91bccd0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:37.359329 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d53d1ff5-5081-4bd8-ac94-58dfe91bccd0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:37.361607 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d53d1ff5-5081-4bd8-ac94-58dfe91bccd0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:37.363899 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d53d1ff5-5081-4bd8-ac94-58dfe91bccd0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:37.615888 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d53d1ff5-5081-4bd8-ac94-58dfe91bccd0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 27617 microversion: 2.20 time: 0.282140 Dec 16 14:40:37.617745 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 69/147] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:37 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 27617 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:37.802781 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-88e48b14-b613-4e44-9b6f-302add98c7ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:37.804649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-88e48b14-b613-4e44-9b6f-302add98c7ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:37.829050 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-88e48b14-b613-4e44-9b6f-302add98c7ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:37.830950 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-88e48b14-b613-4e44-9b6f-302add98c7ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:37.833676 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-88e48b14-b613-4e44-9b6f-302add98c7ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:37.834783 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-88e48b14-b613-4e44-9b6f-302add98c7ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.084518 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4f7928eb-a534-4f3d-9fa5-5022eae6f0ba tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:38.085418 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4f7928eb-a534-4f3d-9fa5-5022eae6f0ba tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:38.100032 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f7928eb-a534-4f3d-9fa5-5022eae6f0ba tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.101590 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f7928eb-a534-4f3d-9fa5-5022eae6f0ba tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.102417 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f7928eb-a534-4f3d-9fa5-5022eae6f0ba tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.102857 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f7928eb-a534-4f3d-9fa5-5022eae6f0ba tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.359874 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4f7928eb-a534-4f3d-9fa5-5022eae6f0ba tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:38.377335 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4f7928eb-a534-4f3d-9fa5-5022eae6f0ba tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1270 microversion: 2.1 time: 0.296407 Dec 16 14:40:38.380453 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 70/148] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:38 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1270 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:38.401050 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-88e48b14-b613-4e44-9b6f-302add98c7ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:38.414506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-88e48b14-b613-4e44-9b6f-302add98c7ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.618886 Dec 16 14:40:38.424026 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 79/149] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:37 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:38.627985 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-506c1ea6-640d-4b81-b0b0-ce81a3ae1807 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:38.629864 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-506c1ea6-640d-4b81-b0b0-ce81a3ae1807 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:38.653855 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-506c1ea6-640d-4b81-b0b0-ce81a3ae1807 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.654802 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-506c1ea6-640d-4b81-b0b0-ce81a3ae1807 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.657840 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-506c1ea6-640d-4b81-b0b0-ce81a3ae1807 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:38.660290 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-506c1ea6-640d-4b81-b0b0-ce81a3ae1807 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:38.891541 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-506c1ea6-640d-4b81-b0b0-ce81a3ae1807 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 27853 microversion: 2.20 time: 0.267511 Dec 16 14:40:38.892481 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 71/150] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:38 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 27853 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:39.403223 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-45f9a02d-7729-471d-85c6-6b337dd03aaf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:39.404459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-45f9a02d-7729-471d-85c6-6b337dd03aaf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:39.412363 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-45f9a02d-7729-471d-85c6-6b337dd03aaf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:39.413340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-45f9a02d-7729-471d-85c6-6b337dd03aaf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:39.414644 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-45f9a02d-7729-471d-85c6-6b337dd03aaf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:39.415321 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-45f9a02d-7729-471d-85c6-6b337dd03aaf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:39.432257 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-794ca35c-104b-4f5a-907d-2f5094777d4f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:39.433663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-794ca35c-104b-4f5a-907d-2f5094777d4f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:39.455328 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-794ca35c-104b-4f5a-907d-2f5094777d4f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:39.456028 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-794ca35c-104b-4f5a-907d-2f5094777d4f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:39.457405 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-794ca35c-104b-4f5a-907d-2f5094777d4f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:39.457982 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-794ca35c-104b-4f5a-907d-2f5094777d4f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:39.684917 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-45f9a02d-7729-471d-85c6-6b337dd03aaf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:39.701943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-45f9a02d-7729-471d-85c6-6b337dd03aaf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1276 microversion: 2.1 time: 0.302525 Dec 16 14:40:39.702949 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 80/151] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:39 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1276 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:39.904113 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c80e0e96-26af-4c32-8672-c8d659297efe tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:39.905620 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c80e0e96-26af-4c32-8672-c8d659297efe tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:39.920671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c80e0e96-26af-4c32-8672-c8d659297efe tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:39.921153 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c80e0e96-26af-4c32-8672-c8d659297efe tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:39.921929 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c80e0e96-26af-4c32-8672-c8d659297efe tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:39.922359 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c80e0e96-26af-4c32-8672-c8d659297efe tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:39.952274 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-794ca35c-104b-4f5a-907d-2f5094777d4f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:39.963221 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-794ca35c-104b-4f5a-907d-2f5094777d4f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.536200 Dec 16 14:40:39.968066 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 72/152] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:39 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:40.122821 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c80e0e96-26af-4c32-8672-c8d659297efe tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 28223 microversion: 2.20 time: 0.222283 Dec 16 14:40:40.124074 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 81/153] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:39 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 28223 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:40.719316 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-dda2a9d7-707f-41a8-9a1e-331c88f7c4ad tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:40.719930 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-dda2a9d7-707f-41a8-9a1e-331c88f7c4ad tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:40.729441 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dda2a9d7-707f-41a8-9a1e-331c88f7c4ad tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:40.729904 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dda2a9d7-707f-41a8-9a1e-331c88f7c4ad tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:40.730885 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dda2a9d7-707f-41a8-9a1e-331c88f7c4ad tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:40.731322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dda2a9d7-707f-41a8-9a1e-331c88f7c4ad tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:40.983922 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-066fb406-6528-40f1-870a-253496cb6cd9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:40.984744 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-066fb406-6528-40f1-870a-253496cb6cd9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:40.992687 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-066fb406-6528-40f1-870a-253496cb6cd9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:40.993239 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-066fb406-6528-40f1-870a-253496cb6cd9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:40.994073 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-066fb406-6528-40f1-870a-253496cb6cd9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:40.994574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-066fb406-6528-40f1-870a-253496cb6cd9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:41.280299 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-dda2a9d7-707f-41a8-9a1e-331c88f7c4ad tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:41.289223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-dda2a9d7-707f-41a8-9a1e-331c88f7c4ad tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1318 microversion: 2.1 time: 0.573594 Dec 16 14:40:41.289797 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 73/154] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:40 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:41.294399 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-73e2bca2-fb6d-4bfe-8ea9-aeffb49c3a00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:41.295475 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-73e2bca2-fb6d-4bfe-8ea9-aeffb49c3a00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:41.306778 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-73e2bca2-fb6d-4bfe-8ea9-aeffb49c3a00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:41.306778 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-73e2bca2-fb6d-4bfe-8ea9-aeffb49c3a00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:41.307292 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-73e2bca2-fb6d-4bfe-8ea9-aeffb49c3a00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:41.307896 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-73e2bca2-fb6d-4bfe-8ea9-aeffb49c3a00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:41.401123 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-066fb406-6528-40f1-870a-253496cb6cd9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:41.409260 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-066fb406-6528-40f1-870a-253496cb6cd9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.429594 Dec 16 14:40:41.409839 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 82/155] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:40 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:41.414332 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-6740b03a-8c91-4254-99e5-3408bbf2f072 req-9fc0b3f3-1dbf-4a99-9acc-48d42f741589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ce9264-74df-434c-ad40-ecf44eb504b7", "tag": "e53554ce-cefb-44ad-a028-c910c35ef033"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:41.415809 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:41.415809 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:40:41.423970 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-6740b03a-8c91-4254-99e5-3408bbf2f072 req-9fc0b3f3-1dbf-4a99-9acc-48d42f741589 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:41.424405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-6740b03a-8c91-4254-99e5-3408bbf2f072 req-9fc0b3f3-1dbf-4a99-9acc-48d42f741589 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:41.441275 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-6740b03a-8c91-4254-99e5-3408bbf2f072 req-9fc0b3f3-1dbf-4a99-9acc-48d42f741589 service nova] Creating event network-changed:e53554ce-cefb-44ad-a028-c910c35ef033 for instance 01ce9264-74df-434c-ad40-ecf44eb504b7 on hv-cinder-82189 Dec 16 14:40:41.448723 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-6740b03a-8c91-4254-99e5-3408bbf2f072 req-9fc0b3f3-1dbf-4a99-9acc-48d42f741589 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037092 Dec 16 14:40:41.450224 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 83/156] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:41.459668 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-470684999", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "networks": [{"uuid": "a86c2bfe-cd8a-4625-92b8-54f4b30e84fa"}]}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:41.469057 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-73e2bca2-fb6d-4bfe-8ea9-aeffb49c3a00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 28418 microversion: 2.20 time: 0.177760 Dec 16 14:40:41.470206 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 74/157] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:41 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 28418 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:41.552972 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.network.neutron [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] validate_networks() for [('a86c2bfe-cd8a-4625-92b8-54f4b30e84fa', None, None, None)] {{(pid=101914) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:40:42.307759 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-39674c8c-3f0e-4493-91ed-0431299c2621 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:42.308438 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-39674c8c-3f0e-4493-91ed-0431299c2621 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:42.335904 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-39674c8c-3f0e-4493-91ed-0431299c2621 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:42.336368 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-39674c8c-3f0e-4493-91ed-0431299c2621 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:42.338237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-39674c8c-3f0e-4493-91ed-0431299c2621 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:42.338959 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-39674c8c-3f0e-4493-91ed-0431299c2621 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:42.868559 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Flavor limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:40:42.871338 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-39674c8c-3f0e-4493-91ed-0431299c2621 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:42.871942 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Image limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:40:42.872447 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Flavor pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:40:42.874693 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Image pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:40:42.875080 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:40:42.880720 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-39674c8c-3f0e-4493-91ed-0431299c2621 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1318 microversion: 2.1 time: 0.578117 Dec 16 14:40:42.898790 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 75/158] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:42 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1318 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:42.905437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-57134a19-40f8-48df-9a86-4c330df88cb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:42.905437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-57134a19-40f8-48df-9a86-4c330df88cb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:42.912542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:42.913051 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:42.913896 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:42.914332 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:42.917339 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-57134a19-40f8-48df-9a86-4c330df88cb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:42.917781 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-57134a19-40f8-48df-9a86-4c330df88cb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:42.920127 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-57134a19-40f8-48df-9a86-4c330df88cb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:42.922159 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-57134a19-40f8-48df-9a86-4c330df88cb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:42.990070 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Getting quotas for project cd04f3d6f9ef4788bb01db0c11ba554f. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:40:43.004320 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Getting quotas for user cb0d5bf878154c6fa174db6389f2ea70 and project cd04f3d6f9ef4788bb01db0c11ba554f. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:40:43.034865 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Going to run 1 instances... {{(pid=101914) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:40:43.042364 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:40:43.156415 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-46728f86-4540-4b79-bc05-f9d059243274 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703946 Dec 16 14:40:43.157563 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 84/159] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:40:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 1707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:40:43.165096 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-cbe29bef-397e-4d53-b0a4-51f34fc28904 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:43.166982 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-cbe29bef-397e-4d53-b0a4-51f34fc28904 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:43.179090 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cbe29bef-397e-4d53-b0a4-51f34fc28904 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:43.180489 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cbe29bef-397e-4d53-b0a4-51f34fc28904 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:43.181484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cbe29bef-397e-4d53-b0a4-51f34fc28904 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:43.182270 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cbe29bef-397e-4d53-b0a4-51f34fc28904 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:43.310002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-57134a19-40f8-48df-9a86-4c330df88cb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:43.320478 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-57134a19-40f8-48df-9a86-4c330df88cb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1523 microversion: 2.1 time: 0.418748 Dec 16 14:40:43.329447 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 76/160] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:42 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1523 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:43.329447 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5ddeea77-a9fc-45eb-9a4e-ab27d23c7ede tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:43.329447 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5ddeea77-a9fc-45eb-9a4e-ab27d23c7ede tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:43.441063 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-cbe29bef-397e-4d53-b0a4-51f34fc28904 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 28681 microversion: 2.20 time: 0.281910 Dec 16 14:40:43.442318 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 85/161] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:43 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 28681 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:43.450919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5ddeea77-a9fc-45eb-9a4e-ab27d23c7ede tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:43.462076 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5ddeea77-a9fc-45eb-9a4e-ab27d23c7ede tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1218 microversion: 2.1 time: 0.139615 Dec 16 14:40:43.462982 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 77/162] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:43 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:43.907176 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-50d0f3df-6606-44cc-859d-2d8808758f48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:43.907874 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-50d0f3df-6606-44cc-859d-2d8808758f48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:43.915850 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-50d0f3df-6606-44cc-859d-2d8808758f48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:43.916297 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-50d0f3df-6606-44cc-859d-2d8808758f48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:43.917131 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-50d0f3df-6606-44cc-859d-2d8808758f48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:43.917729 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-50d0f3df-6606-44cc-859d-2d8808758f48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:44.114495 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-50d0f3df-6606-44cc-859d-2d8808758f48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:44.124011 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-50d0f3df-6606-44cc-859d-2d8808758f48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1318 microversion: 2.1 time: 0.221002 Dec 16 14:40:44.124656 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 86/163] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:43 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:44.337962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a8c800cc-347b-43ba-9a6b-47b95a52e471 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:44.338607 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a8c800cc-347b-43ba-9a6b-47b95a52e471 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:44.359596 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a8c800cc-347b-43ba-9a6b-47b95a52e471 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:44.360333 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a8c800cc-347b-43ba-9a6b-47b95a52e471 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:44.361217 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a8c800cc-347b-43ba-9a6b-47b95a52e471 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:44.361599 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a8c800cc-347b-43ba-9a6b-47b95a52e471 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:44.455158 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-31ed562b-ef41-4dd4-8a07-ffc7cb76f6b5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:44.456393 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-31ed562b-ef41-4dd4-8a07-ffc7cb76f6b5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:44.468963 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-31ed562b-ef41-4dd4-8a07-ffc7cb76f6b5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:44.470845 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-31ed562b-ef41-4dd4-8a07-ffc7cb76f6b5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:44.473064 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-31ed562b-ef41-4dd4-8a07-ffc7cb76f6b5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:44.476724 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-31ed562b-ef41-4dd4-8a07-ffc7cb76f6b5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:44.656947 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-31ed562b-ef41-4dd4-8a07-ffc7cb76f6b5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 28681 microversion: 2.20 time: 0.205935 Dec 16 14:40:44.657916 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 87/164] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:44 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 28681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:44.675477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2534dc31-285a-4ed2-b136-975c032b301b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:44.676407 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2534dc31-285a-4ed2-b136-975c032b301b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:44.685157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-a8c800cc-347b-43ba-9a6b-47b95a52e471 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:44.686253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2534dc31-285a-4ed2-b136-975c032b301b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:44.686776 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2534dc31-285a-4ed2-b136-975c032b301b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:44.691485 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2534dc31-285a-4ed2-b136-975c032b301b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:44.692903 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2534dc31-285a-4ed2-b136-975c032b301b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:44.704666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a8c800cc-347b-43ba-9a6b-47b95a52e471 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1503 microversion: 2.1 time: 0.370366 Dec 16 14:40:44.710843 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 78/165] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:44 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1503 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:44.730146 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1895bcac-3a17-4e6d-9765-cdc3226a49dc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:44.730758 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1895bcac-3a17-4e6d-9765-cdc3226a49dc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:44.748810 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1895bcac-3a17-4e6d-9765-cdc3226a49dc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:44.749201 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1895bcac-3a17-4e6d-9765-cdc3226a49dc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:44.749990 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1895bcac-3a17-4e6d-9765-cdc3226a49dc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:44.750435 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1895bcac-3a17-4e6d-9765-cdc3226a49dc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:44.996447 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2534dc31-285a-4ed2-b136-975c032b301b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:45.005034 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2534dc31-285a-4ed2-b136-975c032b301b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1288 microversion: 2.1 time: 0.345677 Dec 16 14:40:45.005861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 88/166] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:44 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1288 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:45.144014 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f45e0c7e-ce3d-4558-95fb-e779e5efa199 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:45.144828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f45e0c7e-ce3d-4558-95fb-e779e5efa199 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:45.166478 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f45e0c7e-ce3d-4558-95fb-e779e5efa199 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:45.167112 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f45e0c7e-ce3d-4558-95fb-e779e5efa199 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:45.168267 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f45e0c7e-ce3d-4558-95fb-e779e5efa199 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:45.168766 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f45e0c7e-ce3d-4558-95fb-e779e5efa199 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:45.208799 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1895bcac-3a17-4e6d-9765-cdc3226a49dc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:45.220573 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1895bcac-3a17-4e6d-9765-cdc3226a49dc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1516 microversion: 2.1 time: 0.494002 Dec 16 14:40:45.234810 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 79/167] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:44 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:45.539985 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f45e0c7e-ce3d-4558-95fb-e779e5efa199 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:45.549092 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f45e0c7e-ce3d-4558-95fb-e779e5efa199 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1318 microversion: 2.1 time: 0.411056 Dec 16 14:40:45.549850 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 89/168] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:45 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:45.670718 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0e09ba40-305d-4b7b-8557-027722ecf442 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:45.671708 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0e09ba40-305d-4b7b-8557-027722ecf442 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:45.686711 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0e09ba40-305d-4b7b-8557-027722ecf442 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:45.687156 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0e09ba40-305d-4b7b-8557-027722ecf442 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:45.687935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0e09ba40-305d-4b7b-8557-027722ecf442 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:45.688362 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0e09ba40-305d-4b7b-8557-027722ecf442 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:45.854781 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0e09ba40-305d-4b7b-8557-027722ecf442 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 28681 microversion: 2.20 time: 0.188310 Dec 16 14:40:45.855461 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 80/169] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:45 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 28681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:46.024108 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-20b63a38-2854-45bf-878d-ca396b9f726e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:46.025452 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-20b63a38-2854-45bf-878d-ca396b9f726e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:46.034853 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-20b63a38-2854-45bf-878d-ca396b9f726e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:46.035685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-20b63a38-2854-45bf-878d-ca396b9f726e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:46.036541 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-20b63a38-2854-45bf-878d-ca396b9f726e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:46.037305 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-20b63a38-2854-45bf-878d-ca396b9f726e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:46.523021 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-20b63a38-2854-45bf-878d-ca396b9f726e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:46.533701 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-20b63a38-2854-45bf-878d-ca396b9f726e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1318 microversion: 2.1 time: 0.513623 Dec 16 14:40:46.545020 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 90/170] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:46 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:46.567123 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c40cdd52-a0e5-4b4a-ae21-90b3219b8240 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:46.568680 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c40cdd52-a0e5-4b4a-ae21-90b3219b8240 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:46.584118 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c40cdd52-a0e5-4b4a-ae21-90b3219b8240 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:46.585701 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c40cdd52-a0e5-4b4a-ae21-90b3219b8240 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:46.589721 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c40cdd52-a0e5-4b4a-ae21-90b3219b8240 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:46.590454 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c40cdd52-a0e5-4b4a-ae21-90b3219b8240 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:46.866822 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3ca94277-d865-415a-89c0-0148ef4de22c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:46.868330 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3ca94277-d865-415a-89c0-0148ef4de22c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:46.884693 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ca94277-d865-415a-89c0-0148ef4de22c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:46.885469 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ca94277-d865-415a-89c0-0148ef4de22c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:46.886458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ca94277-d865-415a-89c0-0148ef4de22c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:46.889473 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ca94277-d865-415a-89c0-0148ef4de22c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.035244 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c40cdd52-a0e5-4b4a-ae21-90b3219b8240 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:47.045282 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c40cdd52-a0e5-4b4a-ae21-90b3219b8240 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1318 microversion: 2.1 time: 0.482180 Dec 16 14:40:47.047321 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 81/171] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:46 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:47.056817 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-71f7688a-07c7-4426-8f22-58d48c745b36 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:47.058160 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-71f7688a-07c7-4426-8f22-58d48c745b36 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:47.067683 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-71f7688a-07c7-4426-8f22-58d48c745b36 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.068569 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-71f7688a-07c7-4426-8f22-58d48c745b36 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.071385 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-71f7688a-07c7-4426-8f22-58d48c745b36 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.072083 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-71f7688a-07c7-4426-8f22-58d48c745b36 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.141150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-71f7688a-07c7-4426-8f22-58d48c745b36 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lazy-loading 'flavor' on Instance uuid 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:40:47.237324 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3ca94277-d865-415a-89c0-0148ef4de22c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 28681 microversion: 2.20 time: 0.374309 Dec 16 14:40:47.238067 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 91/172] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:46 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 28681 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:47.245270 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-f3ecc2b0-8ffe-4d00-9d5c-11ce56c4079b req-fcd56cda-ca66-4362-b4e8-845a221cdc82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f59e7d9-2df3-4788-a597-ff7dd7c2acc2", "tag": "638cd2b4-5782-43ae-9e3b-408206bfa8d9"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:47.247206 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:47.247206 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:40:47.257581 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-f3ecc2b0-8ffe-4d00-9d5c-11ce56c4079b req-fcd56cda-ca66-4362-b4e8-845a221cdc82 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.258128 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-f3ecc2b0-8ffe-4d00-9d5c-11ce56c4079b req-fcd56cda-ca66-4362-b4e8-845a221cdc82 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.274704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-f3ecc2b0-8ffe-4d00-9d5c-11ce56c4079b req-fcd56cda-ca66-4362-b4e8-845a221cdc82 service nova] Creating event network-changed:638cd2b4-5782-43ae-9e3b-408206bfa8d9 for instance 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 on hv-cinder-82189 Dec 16 14:40:47.280805 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-f3ecc2b0-8ffe-4d00-9d5c-11ce56c4079b req-fcd56cda-ca66-4362-b4e8-845a221cdc82 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041011 Dec 16 14:40:47.281394 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 92/173] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:47.287029 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-71f7688a-07c7-4426-8f22-58d48c745b36 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/action" status: 200 len: 32 microversion: 2.1 time: 0.237815 Dec 16 14:40:47.288248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 82/174] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:40:47 2021] POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/action => generated 32 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:40:47.297878 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2a996298-5393-488e-bc62-eb67e9624b8d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:47.298582 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2a996298-5393-488e-bc62-eb67e9624b8d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:47.308329 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2a996298-5393-488e-bc62-eb67e9624b8d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.308835 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2a996298-5393-488e-bc62-eb67e9624b8d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.309665 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2a996298-5393-488e-bc62-eb67e9624b8d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.310079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2a996298-5393-488e-bc62-eb67e9624b8d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.551814 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c235141b-be01-4f84-8e17-631d75d82468 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:47.552504 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c235141b-be01-4f84-8e17-631d75d82468 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:47.561086 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c235141b-be01-4f84-8e17-631d75d82468 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.561592 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c235141b-be01-4f84-8e17-631d75d82468 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.562962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c235141b-be01-4f84-8e17-631d75d82468 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.563412 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c235141b-be01-4f84-8e17-631d75d82468 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:47.751107 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2a996298-5393-488e-bc62-eb67e9624b8d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:47.768302 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2a996298-5393-488e-bc62-eb67e9624b8d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.471157 Dec 16 14:40:47.769208 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 93/175] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:47 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:47.966549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-f56ce4c4-0121-4dc7-b8e4-7a78d993a65a req-66569ec5-7289-4800-813b-759f88bb875f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ce9264-74df-434c-ad40-ecf44eb504b7", "name": "network-vif-plugged", "status": "completed", "tag": "e53554ce-cefb-44ad-a028-c910c35ef033"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:47.969290 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:47.969290 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:40:47.983138 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-f56ce4c4-0121-4dc7-b8e4-7a78d993a65a req-66569ec5-7289-4800-813b-759f88bb875f service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:47.983992 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-f56ce4c4-0121-4dc7-b8e4-7a78d993a65a req-66569ec5-7289-4800-813b-759f88bb875f service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.005495 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-f56ce4c4-0121-4dc7-b8e4-7a78d993a65a req-66569ec5-7289-4800-813b-759f88bb875f service nova] Creating event network-vif-plugged:e53554ce-cefb-44ad-a028-c910c35ef033 for instance 01ce9264-74df-434c-ad40-ecf44eb504b7 on hv-cinder-82189 Dec 16 14:40:48.012005 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-f56ce4c4-0121-4dc7-b8e4-7a78d993a65a req-66569ec5-7289-4800-813b-759f88bb875f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050536 Dec 16 14:40:48.013563 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 94/176] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:40:48.064093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e3b9f8d7-2649-44aa-adae-08f68603873e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:48.065609 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e3b9f8d7-2649-44aa-adae-08f68603873e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:48.077430 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e3b9f8d7-2649-44aa-adae-08f68603873e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:48.078564 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e3b9f8d7-2649-44aa-adae-08f68603873e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.079350 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e3b9f8d7-2649-44aa-adae-08f68603873e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:48.079779 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e3b9f8d7-2649-44aa-adae-08f68603873e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.317333 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c235141b-be01-4f84-8e17-631d75d82468 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:48.326473 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c235141b-be01-4f84-8e17-631d75d82468 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1318 microversion: 2.1 time: 0.778627 Dec 16 14:40:48.329985 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 83/177] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:47 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1318 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:48.343140 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c8a4b2dd-0bc2-4f77-95e3-406c6c98d4b8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:48.346275 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c8a4b2dd-0bc2-4f77-95e3-406c6c98d4b8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:48.359510 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8a4b2dd-0bc2-4f77-95e3-406c6c98d4b8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:48.359956 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8a4b2dd-0bc2-4f77-95e3-406c6c98d4b8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.360732 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8a4b2dd-0bc2-4f77-95e3-406c6c98d4b8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:48.361226 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8a4b2dd-0bc2-4f77-95e3-406c6c98d4b8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.501129 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e3b9f8d7-2649-44aa-adae-08f68603873e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:48.513157 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e3b9f8d7-2649-44aa-adae-08f68603873e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1318 microversion: 2.1 time: 0.453123 Dec 16 14:40:48.524141 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 95/178] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:48 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:48.570686 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c8a4b2dd-0bc2-4f77-95e3-406c6c98d4b8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 29415 microversion: 2.20 time: 0.238749 Dec 16 14:40:48.574467 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 84/179] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:48 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 29415 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:48.786827 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9243b3c2-769c-440b-94ad-875e62cda73a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:48.788142 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9243b3c2-769c-440b-94ad-875e62cda73a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:48.795666 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9243b3c2-769c-440b-94ad-875e62cda73a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:48.796192 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9243b3c2-769c-440b-94ad-875e62cda73a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:48.797060 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9243b3c2-769c-440b-94ad-875e62cda73a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:48.797488 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9243b3c2-769c-440b-94ad-875e62cda73a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.188522 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9243b3c2-769c-440b-94ad-875e62cda73a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:49.197532 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9243b3c2-769c-440b-94ad-875e62cda73a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.414638 Dec 16 14:40:49.198098 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 96/180] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:48 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:49.345463 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-dabe6437-5f29-4584-b6f1-9ef119f2ac9d tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:49.346199 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-dabe6437-5f29-4584-b6f1-9ef119f2ac9d tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:49.353891 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dabe6437-5f29-4584-b6f1-9ef119f2ac9d tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.354619 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dabe6437-5f29-4584-b6f1-9ef119f2ac9d tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.355316 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dabe6437-5f29-4584-b6f1-9ef119f2ac9d tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.355701 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dabe6437-5f29-4584-b6f1-9ef119f2ac9d tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.531823 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c122e4e0-ac05-4e01-b3b5-3f6dcaae4642 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:49.532338 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c122e4e0-ac05-4e01-b3b5-3f6dcaae4642 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:49.540944 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c122e4e0-ac05-4e01-b3b5-3f6dcaae4642 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.541401 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c122e4e0-ac05-4e01-b3b5-3f6dcaae4642 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.542811 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c122e4e0-ac05-4e01-b3b5-3f6dcaae4642 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.543298 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c122e4e0-ac05-4e01-b3b5-3f6dcaae4642 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.704774 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-dabe6437-5f29-4584-b6f1-9ef119f2ac9d tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:49.721035 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-dabe6437-5f29-4584-b6f1-9ef119f2ac9d tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1318 microversion: 2.1 time: 0.379434 Dec 16 14:40:49.732738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 85/181] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:49 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:49.737806 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-583282a6-ffe4-44e0-a056-033ed6ef9335 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:49.738726 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-583282a6-ffe4-44e0-a056-033ed6ef9335 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:49.748491 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-583282a6-ffe4-44e0-a056-033ed6ef9335 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.749008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-583282a6-ffe4-44e0-a056-033ed6ef9335 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.749780 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-583282a6-ffe4-44e0-a056-033ed6ef9335 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:49.751119 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-583282a6-ffe4-44e0-a056-033ed6ef9335 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:49.783739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c122e4e0-ac05-4e01-b3b5-3f6dcaae4642 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:49.794734 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c122e4e0-ac05-4e01-b3b5-3f6dcaae4642 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1318 microversion: 2.1 time: 0.267894 Dec 16 14:40:49.796023 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 97/182] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:49 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:49.922115 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-583282a6-ffe4-44e0-a056-033ed6ef9335 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 30808 microversion: 2.20 time: 0.187849 Dec 16 14:40:49.924051 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 86/183] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:49 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 30808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:50.214730 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-726ec016-d6aa-4f7a-a01e-64013db78244 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:50.215646 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-726ec016-d6aa-4f7a-a01e-64013db78244 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:50.224045 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-726ec016-d6aa-4f7a-a01e-64013db78244 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:50.224549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-726ec016-d6aa-4f7a-a01e-64013db78244 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:50.225754 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-726ec016-d6aa-4f7a-a01e-64013db78244 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:50.226441 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-726ec016-d6aa-4f7a-a01e-64013db78244 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:50.580081 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-726ec016-d6aa-4f7a-a01e-64013db78244 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:50.588682 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-726ec016-d6aa-4f7a-a01e-64013db78244 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.377889 Dec 16 14:40:50.589283 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 98/184] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:50 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:50.741911 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3e0aed8e-6b96-4c4c-923e-c75873fcd3ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:50.742873 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3e0aed8e-6b96-4c4c-923e-c75873fcd3ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:50.751420 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3e0aed8e-6b96-4c4c-923e-c75873fcd3ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:50.751861 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3e0aed8e-6b96-4c4c-923e-c75873fcd3ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:50.752818 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3e0aed8e-6b96-4c4c-923e-c75873fcd3ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:50.753248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3e0aed8e-6b96-4c4c-923e-c75873fcd3ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:50.815974 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0d9560b8-1a57-4d4a-bc5c-36ca59065e3f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:50.816886 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0d9560b8-1a57-4d4a-bc5c-36ca59065e3f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:50.826695 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d9560b8-1a57-4d4a-bc5c-36ca59065e3f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:50.827668 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d9560b8-1a57-4d4a-bc5c-36ca59065e3f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:50.828845 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d9560b8-1a57-4d4a-bc5c-36ca59065e3f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:50.829465 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d9560b8-1a57-4d4a-bc5c-36ca59065e3f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:51.024421 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-3e0aed8e-6b96-4c4c-923e-c75873fcd3ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:51.032901 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3e0aed8e-6b96-4c4c-923e-c75873fcd3ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1318 microversion: 2.1 time: 0.296870 Dec 16 14:40:51.033464 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 87/185] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:50 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:51.038363 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2b8e7f1b-f7ce-45e8-a99d-4ebdae1ea5ce tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:51.039620 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2b8e7f1b-f7ce-45e8-a99d-4ebdae1ea5ce tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:51.047602 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b8e7f1b-f7ce-45e8-a99d-4ebdae1ea5ce tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:51.048273 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b8e7f1b-f7ce-45e8-a99d-4ebdae1ea5ce tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:51.048891 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b8e7f1b-f7ce-45e8-a99d-4ebdae1ea5ce tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:51.049477 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b8e7f1b-f7ce-45e8-a99d-4ebdae1ea5ce tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:51.126201 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0d9560b8-1a57-4d4a-bc5c-36ca59065e3f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:51.135007 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0d9560b8-1a57-4d4a-bc5c-36ca59065e3f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1508 microversion: 2.1 time: 0.325948 Dec 16 14:40:51.135574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 99/186] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:50 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:51.201628 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2b8e7f1b-f7ce-45e8-a99d-4ebdae1ea5ce tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 32453 microversion: 2.20 time: 0.166349 Dec 16 14:40:51.202675 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 88/187] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:51 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 32453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:51.607952 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fadc8442-9bd6-4127-9244-d173ea93e879 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:51.608598 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fadc8442-9bd6-4127-9244-d173ea93e879 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:51.623400 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fadc8442-9bd6-4127-9244-d173ea93e879 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:51.624066 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fadc8442-9bd6-4127-9244-d173ea93e879 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:51.624906 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fadc8442-9bd6-4127-9244-d173ea93e879 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:51.625420 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fadc8442-9bd6-4127-9244-d173ea93e879 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:51.853240 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fadc8442-9bd6-4127-9244-d173ea93e879 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:51.862618 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fadc8442-9bd6-4127-9244-d173ea93e879 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.260390 Dec 16 14:40:51.863574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 100/188] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:51 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:52.050335 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1d838760-b5d2-49d7-9396-a9c5a19fa556 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:52.051136 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1d838760-b5d2-49d7-9396-a9c5a19fa556 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:52.060023 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1d838760-b5d2-49d7-9396-a9c5a19fa556 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:52.060626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1d838760-b5d2-49d7-9396-a9c5a19fa556 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:52.061634 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1d838760-b5d2-49d7-9396-a9c5a19fa556 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:52.062244 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1d838760-b5d2-49d7-9396-a9c5a19fa556 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:52.215142 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-374e0d69-6fe9-498d-9d5c-a4e48c6e6ae5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:52.216393 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-374e0d69-6fe9-498d-9d5c-a4e48c6e6ae5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:52.224795 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-374e0d69-6fe9-498d-9d5c-a4e48c6e6ae5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:52.225334 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-374e0d69-6fe9-498d-9d5c-a4e48c6e6ae5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:52.226224 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-374e0d69-6fe9-498d-9d5c-a4e48c6e6ae5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:52.226890 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-374e0d69-6fe9-498d-9d5c-a4e48c6e6ae5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:52.292208 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1d838760-b5d2-49d7-9396-a9c5a19fa556 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:52.311478 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1d838760-b5d2-49d7-9396-a9c5a19fa556 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1318 microversion: 2.1 time: 0.264710 Dec 16 14:40:52.312187 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 89/189] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:52 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:52.375102 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-374e0d69-6fe9-498d-9d5c-a4e48c6e6ae5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 33507 microversion: 2.20 time: 0.164270 Dec 16 14:40:52.375747 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 101/190] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:52 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 33507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:52.717953 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-459a5a90-5c71-4c12-8fcc-338a8f7c3828 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2917df-9efb-431a-a0c3-bedc31b16161"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:52.719827 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-459a5a90-5c71-4c12-8fcc-338a8f7c3828 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:52.733368 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-459a5a90-5c71-4c12-8fcc-338a8f7c3828 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:52.734072 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-459a5a90-5c71-4c12-8fcc-338a8f7c3828 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:52.734900 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-459a5a90-5c71-4c12-8fcc-338a8f7c3828 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:52.735329 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-459a5a90-5c71-4c12-8fcc-338a8f7c3828 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:52.880070 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-980e7950-4f59-420e-b7e3-f296058797e7 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:52.880821 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-980e7950-4f59-420e-b7e3-f296058797e7 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:52.889328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-980e7950-4f59-420e-b7e3-f296058797e7 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:52.889776 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-980e7950-4f59-420e-b7e3-f296058797e7 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:52.890555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-980e7950-4f59-420e-b7e3-f296058797e7 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:52.890989 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-980e7950-4f59-420e-b7e3-f296058797e7 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:53.106776 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-980e7950-4f59-420e-b7e3-f296058797e7 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:53.120829 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-980e7950-4f59-420e-b7e3-f296058797e7 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.244977 Dec 16 14:40:53.121407 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 102/191] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:52 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:53.142550 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-459a5a90-5c71-4c12-8fcc-338a8f7c3828 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "POST /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429065 Dec 16 14:40:53.143618 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 90/192] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:40:52 2021] POST /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:53.329165 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-05933931-c305-455c-8f71-a095344916a8 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:53.330108 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-05933931-c305-455c-8f71-a095344916a8 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:53.339329 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-05933931-c305-455c-8f71-a095344916a8 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:53.339776 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-05933931-c305-455c-8f71-a095344916a8 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:53.340885 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-05933931-c305-455c-8f71-a095344916a8 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:53.341326 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-05933931-c305-455c-8f71-a095344916a8 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:53.390833 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e0bc810f-3a90-40ba-ac54-36f32e914d14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:53.391996 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e0bc810f-3a90-40ba-ac54-36f32e914d14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:53.404225 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e0bc810f-3a90-40ba-ac54-36f32e914d14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:53.404847 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e0bc810f-3a90-40ba-ac54-36f32e914d14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:53.406040 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e0bc810f-3a90-40ba-ac54-36f32e914d14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:53.406586 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e0bc810f-3a90-40ba-ac54-36f32e914d14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:53.560148 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-05933931-c305-455c-8f71-a095344916a8 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:53.568491 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-05933931-c305-455c-8f71-a095344916a8 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1318 microversion: 2.1 time: 0.242957 Dec 16 14:40:53.569303 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 103/193] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:53 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:53.583069 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e0bc810f-3a90-40ba-ac54-36f32e914d14 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 34247 microversion: 2.20 time: 0.198849 Dec 16 14:40:53.584145 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 91/194] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:53 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 34247 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:53.890076 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-c24cd7a8-7607-468e-98e7-6bd7ad72a12b req-0ac08a9c-3f43-4846-9436-186f8bd20b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f59e7d9-2df3-4788-a597-ff7dd7c2acc2", "name": "network-vif-plugged", "status": "completed", "tag": "638cd2b4-5782-43ae-9e3b-408206bfa8d9"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:53.891964 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:40:53.891964 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:40:53.903001 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-c24cd7a8-7607-468e-98e7-6bd7ad72a12b req-0ac08a9c-3f43-4846-9436-186f8bd20b11 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:53.903445 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-c24cd7a8-7607-468e-98e7-6bd7ad72a12b req-0ac08a9c-3f43-4846-9436-186f8bd20b11 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:53.920534 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-c24cd7a8-7607-468e-98e7-6bd7ad72a12b req-0ac08a9c-3f43-4846-9436-186f8bd20b11 service nova] Creating event network-vif-plugged:638cd2b4-5782-43ae-9e3b-408206bfa8d9 for instance 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 on hv-cinder-82189 Dec 16 14:40:53.925255 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-c24cd7a8-7607-468e-98e7-6bd7ad72a12b req-0ac08a9c-3f43-4846-9436-186f8bd20b11 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039358 Dec 16 14:40:53.926043 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 104/195] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:40:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:40:54.139192 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4d81c5be-359f-4edc-9f6b-3647388f66e9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:54.139903 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4d81c5be-359f-4edc-9f6b-3647388f66e9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:54.149322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4d81c5be-359f-4edc-9f6b-3647388f66e9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:54.149978 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4d81c5be-359f-4edc-9f6b-3647388f66e9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:54.150663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4d81c5be-359f-4edc-9f6b-3647388f66e9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:54.151149 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4d81c5be-359f-4edc-9f6b-3647388f66e9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:54.387474 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4d81c5be-359f-4edc-9f6b-3647388f66e9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:54.396665 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4d81c5be-359f-4edc-9f6b-3647388f66e9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.262178 Dec 16 14:40:54.397345 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 92/196] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:54 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:54.587892 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-186f49ff-aa88-40c4-a69c-f667ef7d8ab2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:54.588664 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-186f49ff-aa88-40c4-a69c-f667ef7d8ab2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:54.596105 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-05524eaf-caf0-4d28-9251-040de2595d78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:54.597804 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-186f49ff-aa88-40c4-a69c-f667ef7d8ab2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:54.598029 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-05524eaf-caf0-4d28-9251-040de2595d78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:54.598405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-186f49ff-aa88-40c4-a69c-f667ef7d8ab2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:54.599264 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-186f49ff-aa88-40c4-a69c-f667ef7d8ab2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:54.600369 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-186f49ff-aa88-40c4-a69c-f667ef7d8ab2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:54.609722 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-05524eaf-caf0-4d28-9251-040de2595d78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:54.610434 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-05524eaf-caf0-4d28-9251-040de2595d78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:54.611384 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-05524eaf-caf0-4d28-9251-040de2595d78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:54.612018 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-05524eaf-caf0-4d28-9251-040de2595d78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:54.825048 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-05524eaf-caf0-4d28-9251-040de2595d78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 35037 microversion: 2.20 time: 0.232905 Dec 16 14:40:54.825694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 93/197] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:54 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 35037 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:54.836701 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-186f49ff-aa88-40c4-a69c-f667ef7d8ab2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:54.846536 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-186f49ff-aa88-40c4-a69c-f667ef7d8ab2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1318 microversion: 2.1 time: 0.263633 Dec 16 14:40:54.847505 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 105/198] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:54 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:55.414251 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c269f849-0350-475a-9fdb-e1d2cc06348a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:55.415084 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c269f849-0350-475a-9fdb-e1d2cc06348a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:55.425084 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c269f849-0350-475a-9fdb-e1d2cc06348a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:55.425663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c269f849-0350-475a-9fdb-e1d2cc06348a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:55.426457 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c269f849-0350-475a-9fdb-e1d2cc06348a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:55.426894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c269f849-0350-475a-9fdb-e1d2cc06348a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:55.666246 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c269f849-0350-475a-9fdb-e1d2cc06348a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:55.679424 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c269f849-0350-475a-9fdb-e1d2cc06348a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.269876 Dec 16 14:40:55.680012 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 94/199] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:55 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:55.840968 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f188b4a7-9154-4258-b7be-dea153d67150 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:55.842343 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f188b4a7-9154-4258-b7be-dea153d67150 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:55.851526 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f188b4a7-9154-4258-b7be-dea153d67150 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:55.853114 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f188b4a7-9154-4258-b7be-dea153d67150 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:55.854212 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f188b4a7-9154-4258-b7be-dea153d67150 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:55.854828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f188b4a7-9154-4258-b7be-dea153d67150 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:55.863805 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f8f9ec48-ca5f-4b24-a795-03af953b778b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:55.864501 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f8f9ec48-ca5f-4b24-a795-03af953b778b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:55.872264 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f8f9ec48-ca5f-4b24-a795-03af953b778b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:55.873262 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f8f9ec48-ca5f-4b24-a795-03af953b778b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:55.874399 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f8f9ec48-ca5f-4b24-a795-03af953b778b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:55.875588 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f8f9ec48-ca5f-4b24-a795-03af953b778b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:56.041134 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f188b4a7-9154-4258-b7be-dea153d67150 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 35940 microversion: 2.20 time: 0.207449 Dec 16 14:40:56.044887 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 106/200] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:55 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 35940 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:40:56.133423 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f8f9ec48-ca5f-4b24-a795-03af953b778b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:56.146575 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f8f9ec48-ca5f-4b24-a795-03af953b778b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1507 microversion: 2.1 time: 0.286567 Dec 16 14:40:56.147097 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 95/201] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:55 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:56.697993 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f020a9c9-f525-435c-85d0-f2f16f72c0b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:56.699312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f020a9c9-f525-435c-85d0-f2f16f72c0b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:56.713489 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f020a9c9-f525-435c-85d0-f2f16f72c0b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:56.716248 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f020a9c9-f525-435c-85d0-f2f16f72c0b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:56.717283 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f020a9c9-f525-435c-85d0-f2f16f72c0b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:56.719546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f020a9c9-f525-435c-85d0-f2f16f72c0b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:57.055001 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a77b117d-55b6-49ac-8016-d8f48cda88ff tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:40:57.055964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a77b117d-55b6-49ac-8016-d8f48cda88ff tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:57.063982 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a77b117d-55b6-49ac-8016-d8f48cda88ff tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:57.064463 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a77b117d-55b6-49ac-8016-d8f48cda88ff tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:57.065244 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a77b117d-55b6-49ac-8016-d8f48cda88ff tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:57.065684 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a77b117d-55b6-49ac-8016-d8f48cda88ff tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:57.279746 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f020a9c9-f525-435c-85d0-f2f16f72c0b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:57.288873 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f020a9c9-f525-435c-85d0-f2f16f72c0b3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.596144 Dec 16 14:40:57.289434 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 107/202] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:56 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:40:58.306542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7f4719d6-a58c-4904-8e90-4adbe5ea7806 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:58.307297 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7f4719d6-a58c-4904-8e90-4adbe5ea7806 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:58.315555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f4719d6-a58c-4904-8e90-4adbe5ea7806 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:58.316009 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f4719d6-a58c-4904-8e90-4adbe5ea7806 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:58.316794 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f4719d6-a58c-4904-8e90-4adbe5ea7806 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:58.317253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f4719d6-a58c-4904-8e90-4adbe5ea7806 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:58.588052 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7f4719d6-a58c-4904-8e90-4adbe5ea7806 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:58.596600 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7f4719d6-a58c-4904-8e90-4adbe5ea7806 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.294786 Dec 16 14:40:58.597558 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 108/203] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:58 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:40:59.613042 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-076e4c3b-4519-4908-a177-1d980959c2ef tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:40:59.613850 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-076e4c3b-4519-4908-a177-1d980959c2ef tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:40:59.622312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-076e4c3b-4519-4908-a177-1d980959c2ef tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:59.622860 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-076e4c3b-4519-4908-a177-1d980959c2ef tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:59.623725 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-076e4c3b-4519-4908-a177-1d980959c2ef tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:40:59.624229 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-076e4c3b-4519-4908-a177-1d980959c2ef tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:40:59.692386 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a77b117d-55b6-49ac-8016-d8f48cda88ff tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 38223 microversion: 2.20 time: 2.641212 Dec 16 14:40:59.696619 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 96/204] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:40:57 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 38223 bytes in 2643 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:40:59.869995 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-076e4c3b-4519-4908-a177-1d980959c2ef tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:40:59.878394 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-076e4c3b-4519-4908-a177-1d980959c2ef tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.268998 Dec 16 14:40:59.879777 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 109/205] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:40:59 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:00.704867 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-500c4b2e-29b0-4435-8701-0d1fb296a030 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:00.705883 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-500c4b2e-29b0-4435-8701-0d1fb296a030 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:00.714482 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-500c4b2e-29b0-4435-8701-0d1fb296a030 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:00.714967 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-500c4b2e-29b0-4435-8701-0d1fb296a030 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:00.715750 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-500c4b2e-29b0-4435-8701-0d1fb296a030 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:00.716225 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-500c4b2e-29b0-4435-8701-0d1fb296a030 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:00.867299 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-500c4b2e-29b0-4435-8701-0d1fb296a030 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 38223 microversion: 2.20 time: 0.166343 Dec 16 14:41:00.868252 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 97/206] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:41:00 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 38223 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:41:00.894194 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1fda3ad7-f52e-4111-a2b5-0ad0f1251b28 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:00.895597 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1fda3ad7-f52e-4111-a2b5-0ad0f1251b28 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:00.908279 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1fda3ad7-f52e-4111-a2b5-0ad0f1251b28 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:00.915768 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1fda3ad7-f52e-4111-a2b5-0ad0f1251b28 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:00.916604 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1fda3ad7-f52e-4111-a2b5-0ad0f1251b28 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:00.917125 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1fda3ad7-f52e-4111-a2b5-0ad0f1251b28 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:01.233055 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1fda3ad7-f52e-4111-a2b5-0ad0f1251b28 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:01.242249 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1fda3ad7-f52e-4111-a2b5-0ad0f1251b28 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.351580 Dec 16 14:41:01.243360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 110/207] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:00 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:01.473399 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-360883222", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "networks": [{"uuid": "80a0dcd7-59dc-485e-9feb-7d18fa3c28f8"}]}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:01.550079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] validate_networks() for [('80a0dcd7-59dc-485e-9feb-7d18fa3c28f8', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:41:01.879257 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3143c9cb-fb48-4e89-ab76-39b8441827e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:01.880847 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3143c9cb-fb48-4e89-ab76-39b8441827e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:01.889522 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3143c9cb-fb48-4e89-ab76-39b8441827e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:01.890384 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3143c9cb-fb48-4e89-ab76-39b8441827e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:01.891398 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3143c9cb-fb48-4e89-ab76-39b8441827e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:01.892037 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3143c9cb-fb48-4e89-ab76-39b8441827e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:02.051191 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3143c9cb-fb48-4e89-ab76-39b8441827e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 200 len: 38364 microversion: 2.20 time: 0.175781 Dec 16 14:41:02.052743 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 111/208] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:41:01 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 38364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:41:02.064316 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-82dffae7-b311-4fe6-b3b4-d8a7f4ec4961 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:02.065187 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-82dffae7-b311-4fe6-b3b4-d8a7f4ec4961 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:02.073239 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82dffae7-b311-4fe6-b3b4-d8a7f4ec4961 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:02.073681 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82dffae7-b311-4fe6-b3b4-d8a7f4ec4961 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:02.074443 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82dffae7-b311-4fe6-b3b4-d8a7f4ec4961 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:02.074867 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82dffae7-b311-4fe6-b3b4-d8a7f4ec4961 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:02.106825 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:41:02.107448 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:41:02.107815 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:41:02.108255 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:41:02.108884 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:41:02.119537 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:02.120456 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:02.121693 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:02.122469 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:02.144941 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Getting quotas for project 5a10c6d1e7e7425bb59f6efad4231db3. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:41:02.150456 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Getting quotas for user eeb2dde456a8408d820d765c54f8a868 and project 5a10c6d1e7e7425bb59f6efad4231db3. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:41:02.153157 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-82dffae7-b311-4fe6-b3b4-d8a7f4ec4961 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/ips" status: 200 len: 152 microversion: 2.20 time: 0.090580 Dec 16 14:41:02.154006 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 112/209] 10.222.0.64 () {60 vars in 1288 bytes} [Thu Dec 16 14:41:02 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/ips => generated 152 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:41:02.179416 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:41:02.182318 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:41:02.248006 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-64ff4988-7ed3-41be-9e4b-a61e432c42d8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778088 Dec 16 14:41:02.249748 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 98/210] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:41:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:41:02.260104 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ddd68b95-5042-4b65-acf6-3524d0d514c9 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:02.260950 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ddd68b95-5042-4b65-acf6-3524d0d514c9 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:02.261660 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-338faf40-4252-4ac7-a9b5-28a598a709e5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:02.262685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-338faf40-4252-4ac7-a9b5-28a598a709e5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:02.281381 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-338faf40-4252-4ac7-a9b5-28a598a709e5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:02.282017 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-338faf40-4252-4ac7-a9b5-28a598a709e5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:02.282981 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-338faf40-4252-4ac7-a9b5-28a598a709e5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:02.283574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-338faf40-4252-4ac7-a9b5-28a598a709e5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:02.417978 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ddd68b95-5042-4b65-acf6-3524d0d514c9 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:02.430510 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ddd68b95-5042-4b65-acf6-3524d0d514c9 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1217 microversion: 2.1 time: 0.174366 Dec 16 14:41:02.436539 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 99/211] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:02 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:02.557553 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-338faf40-4252-4ac7-a9b5-28a598a709e5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:02.569919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-338faf40-4252-4ac7-a9b5-28a598a709e5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.313762 Dec 16 14:41:02.570760 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 113/212] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:02 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:03.447622 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6c31f555-f382-4fca-8f1b-15826135e291 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:03.448221 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6c31f555-f382-4fca-8f1b-15826135e291 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:03.456088 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6c31f555-f382-4fca-8f1b-15826135e291 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:03.456530 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6c31f555-f382-4fca-8f1b-15826135e291 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:03.457328 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6c31f555-f382-4fca-8f1b-15826135e291 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:03.457753 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6c31f555-f382-4fca-8f1b-15826135e291 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:03.571618 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6c31f555-f382-4fca-8f1b-15826135e291 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:03.580321 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6c31f555-f382-4fca-8f1b-15826135e291 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1269 microversion: 2.1 time: 0.136312 Dec 16 14:41:03.580923 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 100/213] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:03 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1269 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:03.590666 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1b08c15e-d223-42d2-a0af-2cf66470735b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:03.590666 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1b08c15e-d223-42d2-a0af-2cf66470735b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:03.598917 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1b08c15e-d223-42d2-a0af-2cf66470735b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:03.600087 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1b08c15e-d223-42d2-a0af-2cf66470735b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:03.600975 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1b08c15e-d223-42d2-a0af-2cf66470735b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:03.601485 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1b08c15e-d223-42d2-a0af-2cf66470735b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:03.969519 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1b08c15e-d223-42d2-a0af-2cf66470735b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:03.982320 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1b08c15e-d223-42d2-a0af-2cf66470735b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1502 microversion: 2.1 time: 0.399080 Dec 16 14:41:03.989813 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 114/214] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:03 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1502 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:04.002465 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f24690e5-8596-4ee0-847f-036e2b56db5a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbe10cb6-29cf-426c-b7ca-c7cba13e9f31"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:04.003777 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f24690e5-8596-4ee0-847f-036e2b56db5a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:04.017233 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f24690e5-8596-4ee0-847f-036e2b56db5a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.017675 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f24690e5-8596-4ee0-847f-036e2b56db5a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.020466 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f24690e5-8596-4ee0-847f-036e2b56db5a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.022758 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f24690e5-8596-4ee0-847f-036e2b56db5a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.106342 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-f24690e5-8596-4ee0-847f-036e2b56db5a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] HTTP exception thrown: Cannot 'attach_volume' instance 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 while it is in vm_state rescued Dec 16 14:41:04.107007 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f24690e5-8596-4ee0-847f-036e2b56db5a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Returning 409 to user: Cannot 'attach_volume' instance 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 while it is in vm_state rescued {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:41:04.107900 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f24690e5-8596-4ee0-847f-036e2b56db5a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.109680 Dec 16 14:41:04.108525 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 101/215] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:41:03 2021] POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 16 14:41:04.118168 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-82a07f66-75e6-41a4-8e04-c4eb416e2ab8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:04.118775 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-82a07f66-75e6-41a4-8e04-c4eb416e2ab8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:04.126288 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82a07f66-75e6-41a4-8e04-c4eb416e2ab8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.126996 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82a07f66-75e6-41a4-8e04-c4eb416e2ab8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.127845 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82a07f66-75e6-41a4-8e04-c4eb416e2ab8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.131254 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82a07f66-75e6-41a4-8e04-c4eb416e2ab8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.261905 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-82a07f66-75e6-41a4-8e04-c4eb416e2ab8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/action" status: 202 len: 0 microversion: 2.1 time: 0.148272 Dec 16 14:41:04.262529 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 115/216] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:41:04 2021] POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:41:04.271600 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-253afc83-613e-45c6-a15b-267e4818b36e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:04.272214 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-253afc83-613e-45c6-a15b-267e4818b36e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:04.279434 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-253afc83-613e-45c6-a15b-267e4818b36e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.279880 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-253afc83-613e-45c6-a15b-267e4818b36e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.280642 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-253afc83-613e-45c6-a15b-267e4818b36e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.281110 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-253afc83-613e-45c6-a15b-267e4818b36e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.479445 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-253afc83-613e-45c6-a15b-267e4818b36e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:04.487572 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-253afc83-613e-45c6-a15b-267e4818b36e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1510 microversion: 2.1 time: 0.220766 Dec 16 14:41:04.488125 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 102/217] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:04 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:04.598284 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-df185a8f-c6db-4e84-9d95-4b3dd6d4f10d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:04.598965 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-df185a8f-c6db-4e84-9d95-4b3dd6d4f10d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:04.606320 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-df185a8f-c6db-4e84-9d95-4b3dd6d4f10d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.606759 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-df185a8f-c6db-4e84-9d95-4b3dd6d4f10d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.607540 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-df185a8f-c6db-4e84-9d95-4b3dd6d4f10d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:04.607967 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-df185a8f-c6db-4e84-9d95-4b3dd6d4f10d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:04.721555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-df185a8f-c6db-4e84-9d95-4b3dd6d4f10d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:04.730162 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-df185a8f-c6db-4e84-9d95-4b3dd6d4f10d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1275 microversion: 2.1 time: 0.135947 Dec 16 14:41:04.730707 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 116/218] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:04 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:05.505003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-bb2fab80-50d9-4ea9-b609-1b0bab0c71fc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:05.506153 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-bb2fab80-50d9-4ea9-b609-1b0bab0c71fc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:05.514062 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bb2fab80-50d9-4ea9-b609-1b0bab0c71fc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:05.514517 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bb2fab80-50d9-4ea9-b609-1b0bab0c71fc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:05.515288 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bb2fab80-50d9-4ea9-b609-1b0bab0c71fc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:05.515730 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bb2fab80-50d9-4ea9-b609-1b0bab0c71fc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:05.710786 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-bb2fab80-50d9-4ea9-b609-1b0bab0c71fc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:05.721251 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-bb2fab80-50d9-4ea9-b609-1b0bab0c71fc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1510 microversion: 2.1 time: 0.219987 Dec 16 14:41:05.721929 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 103/219] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:05 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:05.746826 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-71d52ad2-c631-4fcf-8ae0-451354ace834 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:05.747346 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-71d52ad2-c631-4fcf-8ae0-451354ace834 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:05.755599 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-71d52ad2-c631-4fcf-8ae0-451354ace834 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:05.755966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-71d52ad2-c631-4fcf-8ae0-451354ace834 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:05.756741 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-71d52ad2-c631-4fcf-8ae0-451354ace834 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:05.757199 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-71d52ad2-c631-4fcf-8ae0-451354ace834 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:05.870598 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-71d52ad2-c631-4fcf-8ae0-451354ace834 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:05.879348 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-71d52ad2-c631-4fcf-8ae0-451354ace834 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1275 microversion: 2.1 time: 0.136177 Dec 16 14:41:05.885509 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 117/220] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:05 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:06.739715 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-34fb3f7b-02d2-4340-bfc1-9149fb89b4f9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:06.740312 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-34fb3f7b-02d2-4340-bfc1-9149fb89b4f9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:06.747820 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-34fb3f7b-02d2-4340-bfc1-9149fb89b4f9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:06.748263 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-34fb3f7b-02d2-4340-bfc1-9149fb89b4f9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:06.749061 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-34fb3f7b-02d2-4340-bfc1-9149fb89b4f9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:06.749497 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-34fb3f7b-02d2-4340-bfc1-9149fb89b4f9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:06.897646 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4e6fa14d-2075-4ffc-abd3-7c116d221654 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:06.898330 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4e6fa14d-2075-4ffc-abd3-7c116d221654 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:06.911232 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4e6fa14d-2075-4ffc-abd3-7c116d221654 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:06.913168 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4e6fa14d-2075-4ffc-abd3-7c116d221654 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:06.914905 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4e6fa14d-2075-4ffc-abd3-7c116d221654 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:06.915399 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4e6fa14d-2075-4ffc-abd3-7c116d221654 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.171218 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4e6fa14d-2075-4ffc-abd3-7c116d221654 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:07.175645 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-34fb3f7b-02d2-4340-bfc1-9149fb89b4f9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:07.180984 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4e6fa14d-2075-4ffc-abd3-7c116d221654 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1275 microversion: 2.1 time: 0.287658 Dec 16 14:41:07.181890 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 118/221] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:06 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:07.190140 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-34fb3f7b-02d2-4340-bfc1-9149fb89b4f9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1510 microversion: 2.1 time: 0.454091 Dec 16 14:41:07.191318 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 104/222] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:06 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:07.251286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-612348b6-9d09-4c9d-98af-c886e8ae4972 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:07.251882 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-612348b6-9d09-4c9d-98af-c886e8ae4972 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:07.259849 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-612348b6-9d09-4c9d-98af-c886e8ae4972 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:07.260304 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-612348b6-9d09-4c9d-98af-c886e8ae4972 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.261111 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-612348b6-9d09-4c9d-98af-c886e8ae4972 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:07.261553 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-612348b6-9d09-4c9d-98af-c886e8ae4972 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.318462 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-612348b6-9d09-4c9d-98af-c886e8ae4972 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lazy-loading 'flavor' on Instance uuid a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:41:07.715740 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-612348b6-9d09-4c9d-98af-c886e8ae4972 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 202 len: 0 microversion: 2.20 time: 0.468075 Dec 16 14:41:07.718006 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 119/223] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:41:07 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:41:07.726757 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5d51ac9c-de8f-47ff-8fef-5aa0031aae8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:07.727656 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5d51ac9c-de8f-47ff-8fef-5aa0031aae8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:07.742829 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d51ac9c-de8f-47ff-8fef-5aa0031aae8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:07.743460 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d51ac9c-de8f-47ff-8fef-5aa0031aae8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:07.744594 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d51ac9c-de8f-47ff-8fef-5aa0031aae8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:07.745336 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d51ac9c-de8f-47ff-8fef-5aa0031aae8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:08.178654 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5d51ac9c-de8f-47ff-8fef-5aa0031aae8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:08.188166 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5d51ac9c-de8f-47ff-8fef-5aa0031aae8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:08.189841 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5d51ac9c-de8f-47ff-8fef-5aa0031aae8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:08.191131 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5d51ac9c-de8f-47ff-8fef-5aa0031aae8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.468612 Dec 16 14:41:08.191781 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 105/224] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:07 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:08.200161 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-320961a6-77fb-45fa-a32d-a98f6d8589c6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:08.201200 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-320961a6-77fb-45fa-a32d-a98f6d8589c6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:08.212333 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-87b282dc-9995-449f-b748-1556fd29d815 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:08.213052 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-87b282dc-9995-449f-b748-1556fd29d815 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:08.216077 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-320961a6-77fb-45fa-a32d-a98f6d8589c6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:08.216525 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-320961a6-77fb-45fa-a32d-a98f6d8589c6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:08.217480 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-320961a6-77fb-45fa-a32d-a98f6d8589c6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:08.217917 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-320961a6-77fb-45fa-a32d-a98f6d8589c6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:08.222176 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87b282dc-9995-449f-b748-1556fd29d815 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:08.222871 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87b282dc-9995-449f-b748-1556fd29d815 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:08.224480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87b282dc-9995-449f-b748-1556fd29d815 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:08.225147 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87b282dc-9995-449f-b748-1556fd29d815 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:08.795110 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-87b282dc-9995-449f-b748-1556fd29d815 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:08.807904 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-87b282dc-9995-449f-b748-1556fd29d815 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1510 microversion: 2.1 time: 0.603058 Dec 16 14:41:08.808668 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 106/225] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:08 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1510 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:08.820120 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-320961a6-77fb-45fa-a32d-a98f6d8589c6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:08.831355 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-320961a6-77fb-45fa-a32d-a98f6d8589c6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1317 microversion: 2.1 time: 0.635997 Dec 16 14:41:08.832890 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 120/226] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:08 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:09.210614 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d16259f2-4db4-42d0-95b6-08fbba97ba02 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:09.211320 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d16259f2-4db4-42d0-95b6-08fbba97ba02 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:09.219688 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d16259f2-4db4-42d0-95b6-08fbba97ba02 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.220549 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d16259f2-4db4-42d0-95b6-08fbba97ba02 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:09.221479 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d16259f2-4db4-42d0-95b6-08fbba97ba02 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.222137 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d16259f2-4db4-42d0-95b6-08fbba97ba02 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:09.518244 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-aa6ac167-1ddd-46ea-93fc-c868e2addb4d req-d5b1f78e-0bd3-41e4-b6d8-2f3b08b65ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19282f1-e400-4c06-a465-9524cd228d7f", "tag": "3e9e92ef-3756-4082-9f93-e0baddec24b4"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:09.522126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:09.522126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:41:09.533539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-aa6ac167-1ddd-46ea-93fc-c868e2addb4d req-d5b1f78e-0bd3-41e4-b6d8-2f3b08b65ee5 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.534163 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-aa6ac167-1ddd-46ea-93fc-c868e2addb4d req-d5b1f78e-0bd3-41e4-b6d8-2f3b08b65ee5 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:09.554593 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-aa6ac167-1ddd-46ea-93fc-c868e2addb4d req-d5b1f78e-0bd3-41e4-b6d8-2f3b08b65ee5 service nova] Creating event network-changed:3e9e92ef-3756-4082-9f93-e0baddec24b4 for instance e19282f1-e400-4c06-a465-9524cd228d7f on hv-cinder-82189 Dec 16 14:41:09.559107 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d16259f2-4db4-42d0-95b6-08fbba97ba02 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:09.559338 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-aa6ac167-1ddd-46ea-93fc-c868e2addb4d req-d5b1f78e-0bd3-41e4-b6d8-2f3b08b65ee5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047407 Dec 16 14:41:09.561018 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 121/227] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:41:09.570045 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d16259f2-4db4-42d0-95b6-08fbba97ba02 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:09.571596 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d16259f2-4db4-42d0-95b6-08fbba97ba02 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:09.572719 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d16259f2-4db4-42d0-95b6-08fbba97ba02 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.366648 Dec 16 14:41:09.573318 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 107/228] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:09 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:09.825285 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8ad646b6-bd60-4eef-a67d-3932b00a858c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:09.826458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8ad646b6-bd60-4eef-a67d-3932b00a858c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:09.835403 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ad646b6-bd60-4eef-a67d-3932b00a858c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.836229 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ad646b6-bd60-4eef-a67d-3932b00a858c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:09.837051 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ad646b6-bd60-4eef-a67d-3932b00a858c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.837490 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ad646b6-bd60-4eef-a67d-3932b00a858c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:09.849980 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b683c5d5-e6b2-4f56-b746-c93a72fa0a1f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:09.851499 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b683c5d5-e6b2-4f56-b746-c93a72fa0a1f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:09.865613 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b683c5d5-e6b2-4f56-b746-c93a72fa0a1f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.870006 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b683c5d5-e6b2-4f56-b746-c93a72fa0a1f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:09.871454 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b683c5d5-e6b2-4f56-b746-c93a72fa0a1f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:09.872244 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b683c5d5-e6b2-4f56-b746-c93a72fa0a1f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:10.268089 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8ad646b6-bd60-4eef-a67d-3932b00a858c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:10.277458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8ad646b6-bd60-4eef-a67d-3932b00a858c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1510 microversion: 2.1 time: 0.456189 Dec 16 14:41:10.283764 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 122/229] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:09 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1510 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:10.378016 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b683c5d5-e6b2-4f56-b746-c93a72fa0a1f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:10.390760 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b683c5d5-e6b2-4f56-b746-c93a72fa0a1f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1317 microversion: 2.1 time: 0.545186 Dec 16 14:41:10.401552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 108/230] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:09 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:10.591717 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8e0c09e4-f1df-445b-bf36-19a199d30e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:10.592323 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8e0c09e4-f1df-445b-bf36-19a199d30e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:10.600048 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8e0c09e4-f1df-445b-bf36-19a199d30e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:10.600495 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8e0c09e4-f1df-445b-bf36-19a199d30e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:10.601328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8e0c09e4-f1df-445b-bf36-19a199d30e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:10.601775 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8e0c09e4-f1df-445b-bf36-19a199d30e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:11.038338 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8e0c09e4-f1df-445b-bf36-19a199d30e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:11.047247 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8e0c09e4-f1df-445b-bf36-19a199d30e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:11.048812 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8e0c09e4-f1df-445b-bf36-19a199d30e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:11.049881 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8e0c09e4-f1df-445b-bf36-19a199d30e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.461926 Dec 16 14:41:11.061646 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 123/231] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:10 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:11.295718 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f75fc433-73c0-4bcb-8def-627203afebd2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:11.300374 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f75fc433-73c0-4bcb-8def-627203afebd2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:11.309238 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f75fc433-73c0-4bcb-8def-627203afebd2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:11.309917 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f75fc433-73c0-4bcb-8def-627203afebd2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:11.320028 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f75fc433-73c0-4bcb-8def-627203afebd2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:11.320594 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f75fc433-73c0-4bcb-8def-627203afebd2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:11.409767 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7da7d660-0a84-4d3b-ad11-aa34299a48d1 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:11.410541 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7da7d660-0a84-4d3b-ad11-aa34299a48d1 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:11.425673 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7da7d660-0a84-4d3b-ad11-aa34299a48d1 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:11.426966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7da7d660-0a84-4d3b-ad11-aa34299a48d1 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:11.428984 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7da7d660-0a84-4d3b-ad11-aa34299a48d1 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:11.431575 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7da7d660-0a84-4d3b-ad11-aa34299a48d1 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:11.748721 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f75fc433-73c0-4bcb-8def-627203afebd2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:11.760517 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f75fc433-73c0-4bcb-8def-627203afebd2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1516 microversion: 2.1 time: 0.469180 Dec 16 14:41:11.762138 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 109/232] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:11 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1516 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:11.780634 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7da7d660-0a84-4d3b-ad11-aa34299a48d1 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:11.792454 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7da7d660-0a84-4d3b-ad11-aa34299a48d1 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1317 microversion: 2.1 time: 0.387007 Dec 16 14:41:11.802395 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 124/233] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:11 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:12.069649 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4884be9d-9131-4817-9882-9b1c23d2616c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:12.070451 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4884be9d-9131-4817-9882-9b1c23d2616c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:12.087484 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4884be9d-9131-4817-9882-9b1c23d2616c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:12.088123 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4884be9d-9131-4817-9882-9b1c23d2616c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:12.089039 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4884be9d-9131-4817-9882-9b1c23d2616c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:12.090226 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4884be9d-9131-4817-9882-9b1c23d2616c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:12.337736 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4884be9d-9131-4817-9882-9b1c23d2616c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:12.347443 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4884be9d-9131-4817-9882-9b1c23d2616c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:12.349683 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4884be9d-9131-4817-9882-9b1c23d2616c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:12.350894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4884be9d-9131-4817-9882-9b1c23d2616c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.286260 Dec 16 14:41:12.351532 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 110/234] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:12 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:12.809989 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-552b5e6a-b526-43f7-a34f-b5574a7dd679 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:12.810561 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-552b5e6a-b526-43f7-a34f-b5574a7dd679 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:12.818454 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-552b5e6a-b526-43f7-a34f-b5574a7dd679 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:12.818902 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-552b5e6a-b526-43f7-a34f-b5574a7dd679 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:12.819716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-552b5e6a-b526-43f7-a34f-b5574a7dd679 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:12.820182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-552b5e6a-b526-43f7-a34f-b5574a7dd679 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.026643 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-552b5e6a-b526-43f7-a34f-b5574a7dd679 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:13.036574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-552b5e6a-b526-43f7-a34f-b5574a7dd679 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1317 microversion: 2.1 time: 0.230600 Dec 16 14:41:13.037175 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 125/235] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:12 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:13.369797 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-61ebddb1-cca6-4042-8bec-4c0700838223 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:13.370414 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-61ebddb1-cca6-4042-8bec-4c0700838223 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:13.382984 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61ebddb1-cca6-4042-8bec-4c0700838223 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:13.383441 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61ebddb1-cca6-4042-8bec-4c0700838223 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.384220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61ebddb1-cca6-4042-8bec-4c0700838223 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:13.384653 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61ebddb1-cca6-4042-8bec-4c0700838223 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.461507 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-55ae69b5-d9c3-4243-9699-e2d2bf02dbfa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:13.462449 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-55ae69b5-d9c3-4243-9699-e2d2bf02dbfa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:13.473472 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-55ae69b5-d9c3-4243-9699-e2d2bf02dbfa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:13.474169 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-55ae69b5-d9c3-4243-9699-e2d2bf02dbfa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.475166 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-55ae69b5-d9c3-4243-9699-e2d2bf02dbfa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:13.475753 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-55ae69b5-d9c3-4243-9699-e2d2bf02dbfa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.897079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-61ebddb1-cca6-4042-8bec-4c0700838223 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:13.911103 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-61ebddb1-cca6-4042-8bec-4c0700838223 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:13.913020 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-61ebddb1-cca6-4042-8bec-4c0700838223 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:13.914432 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-61ebddb1-cca6-4042-8bec-4c0700838223 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.549032 Dec 16 14:41:13.915499 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 111/236] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:13 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:13.916698 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-55ae69b5-d9c3-4243-9699-e2d2bf02dbfa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:13.928372 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-55ae69b5-d9c3-4243-9699-e2d2bf02dbfa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1516 microversion: 2.1 time: 0.472129 Dec 16 14:41:13.929435 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 126/237] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:13 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1516 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:13.947231 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a03f6a2a-4a6a-4c70-8bb3-9bd6bd1da13d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "787b268a-c69b-4467-a6e5-6c229999469f"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:13.948965 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a03f6a2a-4a6a-4c70-8bb3-9bd6bd1da13d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:13.958663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a03f6a2a-4a6a-4c70-8bb3-9bd6bd1da13d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:13.959389 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a03f6a2a-4a6a-4c70-8bb3-9bd6bd1da13d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:13.960808 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a03f6a2a-4a6a-4c70-8bb3-9bd6bd1da13d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:13.962557 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a03f6a2a-4a6a-4c70-8bb3-9bd6bd1da13d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:14.053864 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d5ec3e0f-9b46-438d-b846-13b9d5b90815 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:14.054727 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d5ec3e0f-9b46-438d-b846-13b9d5b90815 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:14.065651 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d5ec3e0f-9b46-438d-b846-13b9d5b90815 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:14.069208 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d5ec3e0f-9b46-438d-b846-13b9d5b90815 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:14.071084 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d5ec3e0f-9b46-438d-b846-13b9d5b90815 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:14.072014 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d5ec3e0f-9b46-438d-b846-13b9d5b90815 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:14.442836 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d5ec3e0f-9b46-438d-b846-13b9d5b90815 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:14.456357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d5ec3e0f-9b46-438d-b846-13b9d5b90815 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1317 microversion: 2.1 time: 0.406719 Dec 16 14:41:14.466441 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 127/238] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:14 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:14.539404 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a03f6a2a-4a6a-4c70-8bb3-9bd6bd1da13d tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.597295 Dec 16 14:41:14.545884 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 112/239] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:41:13 2021] POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments => generated 194 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:14.933402 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-da74ce50-f54c-408e-9fae-9dfecfeb2964 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:14.934012 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-da74ce50-f54c-408e-9fae-9dfecfeb2964 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:14.941708 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da74ce50-f54c-408e-9fae-9dfecfeb2964 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:14.942250 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da74ce50-f54c-408e-9fae-9dfecfeb2964 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:14.943201 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da74ce50-f54c-408e-9fae-9dfecfeb2964 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:14.943680 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da74ce50-f54c-408e-9fae-9dfecfeb2964 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:15.206246 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-da74ce50-f54c-408e-9fae-9dfecfeb2964 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:15.216183 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-da74ce50-f54c-408e-9fae-9dfecfeb2964 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:15.217728 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-da74ce50-f54c-408e-9fae-9dfecfeb2964 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:15.218872 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-da74ce50-f54c-408e-9fae-9dfecfeb2964 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.289953 Dec 16 14:41:15.219423 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 128/240] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:14 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:15.474253 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-13a72ef3-5c2c-4db4-8caf-0a8b48a1fe88 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:15.474900 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-13a72ef3-5c2c-4db4-8caf-0a8b48a1fe88 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:15.483629 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13a72ef3-5c2c-4db4-8caf-0a8b48a1fe88 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:15.484074 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13a72ef3-5c2c-4db4-8caf-0a8b48a1fe88 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:15.484841 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13a72ef3-5c2c-4db4-8caf-0a8b48a1fe88 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:15.485263 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13a72ef3-5c2c-4db4-8caf-0a8b48a1fe88 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:15.911167 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-13a72ef3-5c2c-4db4-8caf-0a8b48a1fe88 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:15.919543 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-13a72ef3-5c2c-4db4-8caf-0a8b48a1fe88 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1317 microversion: 2.1 time: 0.449453 Dec 16 14:41:15.920149 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 113/241] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:15 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:16.108656 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1745688679", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "networks": [{"uuid": "60766b1a-0510-46e5-87ff-a9934f94c446"}]}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:16.175963 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.network.neutron [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] validate_networks() for [('60766b1a-0510-46e5-87ff-a9934f94c446', None, None, None)] {{(pid=101914) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:41:16.239534 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2ba08e15-9859-46d2-9857-f09d221c48c0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:16.240053 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2ba08e15-9859-46d2-9857-f09d221c48c0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:16.248369 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2ba08e15-9859-46d2-9857-f09d221c48c0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.248895 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2ba08e15-9859-46d2-9857-f09d221c48c0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.250026 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2ba08e15-9859-46d2-9857-f09d221c48c0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.250846 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2ba08e15-9859-46d2-9857-f09d221c48c0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.628076 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2ba08e15-9859-46d2-9857-f09d221c48c0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:16.637837 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2ba08e15-9859-46d2-9857-f09d221c48c0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:16.639330 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2ba08e15-9859-46d2-9857-f09d221c48c0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:16.640453 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2ba08e15-9859-46d2-9857-f09d221c48c0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.405393 Dec 16 14:41:16.641035 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 114/242] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:16 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:16.768204 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Flavor limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:41:16.768622 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Image limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:41:16.769131 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Flavor pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:41:16.769542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Image pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:41:16.770777 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:41:16.779721 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.780208 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.781229 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.781669 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.800435 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Getting quotas for project 3a0a8f8b2ba340f1b5d3aacb9646f676. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:41:16.804775 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Getting quotas for user 2a4047bb1e8e42099d2263ee1322450d and project 3a0a8f8b2ba340f1b5d3aacb9646f676. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:41:16.823233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Going to run 1 instances... {{(pid=101914) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:41:16.826243 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:41:16.879252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3ff1072e-72d6-4faf-8404-86e6427a56ec tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774086 Dec 16 14:41:16.885664 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 129/243] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:41:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:41:16.899815 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9c55faf4-3420-43a9-83ae-5338ed2e109b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:16.900933 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9c55faf4-3420-43a9-83ae-5338ed2e109b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:16.936597 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-591efada-7478-4385-9e91-d9ce8c2e0197 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:16.937573 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-591efada-7478-4385-9e91-d9ce8c2e0197 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:16.946855 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-591efada-7478-4385-9e91-d9ce8c2e0197 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.947367 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-591efada-7478-4385-9e91-d9ce8c2e0197 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.948156 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-591efada-7478-4385-9e91-d9ce8c2e0197 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:16.948612 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-591efada-7478-4385-9e91-d9ce8c2e0197 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:16.999828 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9c55faf4-3420-43a9-83ae-5338ed2e109b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:17.026869 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9c55faf4-3420-43a9-83ae-5338ed2e109b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1214 microversion: 2.1 time: 0.138658 Dec 16 14:41:17.029834 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 115/244] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:16 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:17.262349 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-591efada-7478-4385-9e91-d9ce8c2e0197 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:17.271517 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-591efada-7478-4385-9e91-d9ce8c2e0197 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1317 microversion: 2.1 time: 0.339081 Dec 16 14:41:17.272175 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 130/245] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:16 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:17.662314 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-23e8ee7d-d667-4a90-b901-8bad04fb4975 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:17.662885 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-23e8ee7d-d667-4a90-b901-8bad04fb4975 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:17.671698 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-23e8ee7d-d667-4a90-b901-8bad04fb4975 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:17.672141 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-23e8ee7d-d667-4a90-b901-8bad04fb4975 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:17.672968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-23e8ee7d-d667-4a90-b901-8bad04fb4975 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:17.673400 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-23e8ee7d-d667-4a90-b901-8bad04fb4975 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:17.880117 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-23e8ee7d-d667-4a90-b901-8bad04fb4975 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:17.890671 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-23e8ee7d-d667-4a90-b901-8bad04fb4975 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:17.892183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-23e8ee7d-d667-4a90-b901-8bad04fb4975 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:17.893372 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-23e8ee7d-d667-4a90-b901-8bad04fb4975 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.235827 Dec 16 14:41:17.893926 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 116/246] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:17 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:17.981549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-5787aee2-4719-47ad-a111-49ecfeb299b5 req-b6d1ad25-1956-4c71-aea4-f00ae6dec8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19282f1-e400-4c06-a465-9524cd228d7f", "name": "network-vif-plugged", "status": "completed", "tag": "3e9e92ef-3756-4082-9f93-e0baddec24b4"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:17.983260 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:17.983260 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:41:17.992517 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-5787aee2-4719-47ad-a111-49ecfeb299b5 req-b6d1ad25-1956-4c71-aea4-f00ae6dec8e2 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:17.993005 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-5787aee2-4719-47ad-a111-49ecfeb299b5 req-b6d1ad25-1956-4c71-aea4-f00ae6dec8e2 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:18.008826 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-5787aee2-4719-47ad-a111-49ecfeb299b5 req-b6d1ad25-1956-4c71-aea4-f00ae6dec8e2 service nova] Creating event network-vif-plugged:3e9e92ef-3756-4082-9f93-e0baddec24b4 for instance e19282f1-e400-4c06-a465-9524cd228d7f on hv-cinder-82189 Dec 16 14:41:18.013662 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-5787aee2-4719-47ad-a111-49ecfeb299b5 req-b6d1ad25-1956-4c71-aea4-f00ae6dec8e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035829 Dec 16 14:41:18.014259 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 131/247] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:41:18.049703 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-85936166-5a24-4632-adb3-eb4c988ea69e tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:18.050333 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-85936166-5a24-4632-adb3-eb4c988ea69e tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:18.063842 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-85936166-5a24-4632-adb3-eb4c988ea69e tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:18.065622 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-85936166-5a24-4632-adb3-eb4c988ea69e tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:18.065622 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-85936166-5a24-4632-adb3-eb4c988ea69e tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:18.066674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-85936166-5a24-4632-adb3-eb4c988ea69e tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:18.204960 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-85936166-5a24-4632-adb3-eb4c988ea69e tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:18.217437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-85936166-5a24-4632-adb3-eb4c988ea69e tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1266 microversion: 2.1 time: 0.175567 Dec 16 14:41:18.218718 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 117/248] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:18 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:18.289641 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-382b1269-78c9-45c4-ac44-e52c68e9c60e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:18.290362 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-382b1269-78c9-45c4-ac44-e52c68e9c60e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:18.298392 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-382b1269-78c9-45c4-ac44-e52c68e9c60e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:18.298884 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-382b1269-78c9-45c4-ac44-e52c68e9c60e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:18.299874 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-382b1269-78c9-45c4-ac44-e52c68e9c60e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:18.300308 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-382b1269-78c9-45c4-ac44-e52c68e9c60e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:18.694875 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-382b1269-78c9-45c4-ac44-e52c68e9c60e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:18.703834 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-382b1269-78c9-45c4-ac44-e52c68e9c60e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1317 microversion: 2.1 time: 0.419131 Dec 16 14:41:18.704404 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 132/249] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:18 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:18.912075 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b8410126-d571-4b19-8d86-df849c6fe2d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:18.912686 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b8410126-d571-4b19-8d86-df849c6fe2d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:18.920029 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b8410126-d571-4b19-8d86-df849c6fe2d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:18.920490 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b8410126-d571-4b19-8d86-df849c6fe2d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:18.921297 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b8410126-d571-4b19-8d86-df849c6fe2d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:18.921727 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b8410126-d571-4b19-8d86-df849c6fe2d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:19.131594 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b8410126-d571-4b19-8d86-df849c6fe2d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:19.140476 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b8410126-d571-4b19-8d86-df849c6fe2d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:19.142004 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b8410126-d571-4b19-8d86-df849c6fe2d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:19.143446 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b8410126-d571-4b19-8d86-df849c6fe2d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.235197 Dec 16 14:41:19.144002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 118/250] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:18 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:19.235990 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f4cccd79-91d0-4ad4-b507-1e3d063da0f5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:19.236950 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f4cccd79-91d0-4ad4-b507-1e3d063da0f5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:19.246994 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f4cccd79-91d0-4ad4-b507-1e3d063da0f5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:19.248359 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f4cccd79-91d0-4ad4-b507-1e3d063da0f5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:19.250228 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f4cccd79-91d0-4ad4-b507-1e3d063da0f5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:19.250856 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f4cccd79-91d0-4ad4-b507-1e3d063da0f5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:19.473372 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f4cccd79-91d0-4ad4-b507-1e3d063da0f5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:19.483129 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f4cccd79-91d0-4ad4-b507-1e3d063da0f5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.251268 Dec 16 14:41:19.483909 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 133/251] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:19 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:19.720641 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-54709122-5659-4e78-b7ef-b404ed86bd6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:19.721462 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-54709122-5659-4e78-b7ef-b404ed86bd6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:19.729945 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-54709122-5659-4e78-b7ef-b404ed86bd6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:19.730382 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-54709122-5659-4e78-b7ef-b404ed86bd6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:19.731158 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-54709122-5659-4e78-b7ef-b404ed86bd6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:19.731774 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-54709122-5659-4e78-b7ef-b404ed86bd6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.002248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-54709122-5659-4e78-b7ef-b404ed86bd6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:20.016112 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-54709122-5659-4e78-b7ef-b404ed86bd6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1317 microversion: 2.1 time: 0.299006 Dec 16 14:41:20.027483 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 119/252] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:19 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:20.163365 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5e39f8b0-779a-4be0-b51a-95879947ffa3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:20.164382 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5e39f8b0-779a-4be0-b51a-95879947ffa3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:20.171953 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5e39f8b0-779a-4be0-b51a-95879947ffa3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:20.172666 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5e39f8b0-779a-4be0-b51a-95879947ffa3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.173581 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5e39f8b0-779a-4be0-b51a-95879947ffa3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:20.174282 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5e39f8b0-779a-4be0-b51a-95879947ffa3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.377754 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5e39f8b0-779a-4be0-b51a-95879947ffa3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:20.388691 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5e39f8b0-779a-4be0-b51a-95879947ffa3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:20.395550 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5e39f8b0-779a-4be0-b51a-95879947ffa3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:20.397360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5e39f8b0-779a-4be0-b51a-95879947ffa3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.238534 Dec 16 14:41:20.398117 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 134/253] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:20 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:20.501382 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c9c10de3-de32-43d4-abe9-bbde9be8c22c tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:20.503002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c9c10de3-de32-43d4-abe9-bbde9be8c22c tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:20.513523 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c9c10de3-de32-43d4-abe9-bbde9be8c22c tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:20.513957 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c9c10de3-de32-43d4-abe9-bbde9be8c22c tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.514739 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c9c10de3-de32-43d4-abe9-bbde9be8c22c tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:20.516318 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c9c10de3-de32-43d4-abe9-bbde9be8c22c tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.516498 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-41a8246b-b1ff-4f52-b6b5-2b3ca86c88b6 req-c6d7245c-9a33-4e1a-8af3-d2a382e11f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d908e8-0282-46b4-939d-5b760dc9bda7", "tag": "e5a5d4f3-fc09-4d64-b8ed-0a6eb24a6766"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:20.518084 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:20.518084 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:41:20.543990 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-41a8246b-b1ff-4f52-b6b5-2b3ca86c88b6 req-c6d7245c-9a33-4e1a-8af3-d2a382e11f78 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:20.544125 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-41a8246b-b1ff-4f52-b6b5-2b3ca86c88b6 req-c6d7245c-9a33-4e1a-8af3-d2a382e11f78 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:20.560884 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-41a8246b-b1ff-4f52-b6b5-2b3ca86c88b6 req-c6d7245c-9a33-4e1a-8af3-d2a382e11f78 service nova] Creating event network-changed:e5a5d4f3-fc09-4d64-b8ed-0a6eb24a6766 for instance 26d908e8-0282-46b4-939d-5b760dc9bda7 on hv-cinder-82189 Dec 16 14:41:20.565535 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-41a8246b-b1ff-4f52-b6b5-2b3ca86c88b6 req-c6d7245c-9a33-4e1a-8af3-d2a382e11f78 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053346 Dec 16 14:41:20.566122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 135/254] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:20.725420 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c9c10de3-de32-43d4-abe9-bbde9be8c22c tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:20.733561 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c9c10de3-de32-43d4-abe9-bbde9be8c22c tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.236411 Dec 16 14:41:20.734167 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 120/255] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:20 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:21.034396 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-438b32db-76e3-48d2-a47f-651749534c41 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:21.035076 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-438b32db-76e3-48d2-a47f-651749534c41 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:21.042626 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-438b32db-76e3-48d2-a47f-651749534c41 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.043068 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-438b32db-76e3-48d2-a47f-651749534c41 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.043828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-438b32db-76e3-48d2-a47f-651749534c41 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.044253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-438b32db-76e3-48d2-a47f-651749534c41 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.242462 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-438b32db-76e3-48d2-a47f-651749534c41 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:21.250776 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-438b32db-76e3-48d2-a47f-651749534c41 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1506 microversion: 2.1 time: 0.220456 Dec 16 14:41:21.251345 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 136/256] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:21 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:21.266972 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-04d2ff88-8e17-4d9b-ae74-4c74c11f57ac tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2917df-9efb-431a-a0c3-bedc31b16161"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:21.268101 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-04d2ff88-8e17-4d9b-ae74-4c74c11f57ac tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:21.275658 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-04d2ff88-8e17-4d9b-ae74-4c74c11f57ac tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.276121 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-04d2ff88-8e17-4d9b-ae74-4c74c11f57ac tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.276895 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-04d2ff88-8e17-4d9b-ae74-4c74c11f57ac tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.277328 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-04d2ff88-8e17-4d9b-ae74-4c74c11f57ac tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.416182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4c7ae822-4c2a-4e73-9839-0ca734e11a76 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:21.416823 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4c7ae822-4c2a-4e73-9839-0ca734e11a76 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:21.423973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c7ae822-4c2a-4e73-9839-0ca734e11a76 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.424716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c7ae822-4c2a-4e73-9839-0ca734e11a76 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.425253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c7ae822-4c2a-4e73-9839-0ca734e11a76 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.425722 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c7ae822-4c2a-4e73-9839-0ca734e11a76 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.435354 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-04d2ff88-8e17-4d9b-ae74-4c74c11f57ac tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] HTTP exception thrown: Invalid volume: volume 6c2917df-9efb-431a-a0c3-bedc31b16161 is already attached to instances: 01ce9264-74df-434c-ad40-ecf44eb504b7 Dec 16 14:41:21.435947 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-04d2ff88-8e17-4d9b-ae74-4c74c11f57ac tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Returning 400 to user: Invalid volume: volume 6c2917df-9efb-431a-a0c3-bedc31b16161 is already attached to instances: 01ce9264-74df-434c-ad40-ecf44eb504b7 {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:41:21.436899 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-04d2ff88-8e17-4d9b-ae74-4c74c11f57ac tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "POST /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.173707 Dec 16 14:41:21.440958 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 121/257] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:41:21 2021] POST /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f/os-volume_attachments => generated 174 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:41:21.557888 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fb777354-79c4-4457-a790-1f52c21547fb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:21.557888 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fb777354-79c4-4457-a790-1f52c21547fb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:21.562477 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb777354-79c4-4457-a790-1f52c21547fb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.562929 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb777354-79c4-4457-a790-1f52c21547fb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.563707 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb777354-79c4-4457-a790-1f52c21547fb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.564142 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb777354-79c4-4457-a790-1f52c21547fb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.641127 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4c7ae822-4c2a-4e73-9839-0ca734e11a76 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:21.650995 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4c7ae822-4c2a-4e73-9839-0ca734e11a76 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:21.652587 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4c7ae822-4c2a-4e73-9839-0ca734e11a76 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:21.653833 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4c7ae822-4c2a-4e73-9839-0ca734e11a76 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.241762 Dec 16 14:41:21.654469 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 137/258] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:21 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:21.726388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-fb777354-79c4-4457-a790-1f52c21547fb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lazy-loading 'services' on Instance uuid 01ce9264-74df-434c-ad40-ecf44eb504b7 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:41:21.750292 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-473b2b85-9e98-4ab1-b2b8-59aa187f1d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:21.750898 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-473b2b85-9e98-4ab1-b2b8-59aa187f1d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:21.758196 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-473b2b85-9e98-4ab1-b2b8-59aa187f1d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.758648 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-473b2b85-9e98-4ab1-b2b8-59aa187f1d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.759404 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-473b2b85-9e98-4ab1-b2b8-59aa187f1d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.759833 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-473b2b85-9e98-4ab1-b2b8-59aa187f1d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.874306 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fb777354-79c4-4457-a790-1f52c21547fb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "DELETE /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments/6c2917df-9efb-431a-a0c3-bedc31b16161" status: 202 len: 0 microversion: 2.1 time: 0.328123 Dec 16 14:41:21.875005 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 122/259] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:41:21 2021] DELETE /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments/6c2917df-9efb-431a-a0c3-bedc31b16161 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:41:21.883802 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4f507543-c89d-4ab8-ba93-76af161d0816 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:21.885061 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4f507543-c89d-4ab8-ba93-76af161d0816 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:21.892574 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f507543-c89d-4ab8-ba93-76af161d0816 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.893185 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f507543-c89d-4ab8-ba93-76af161d0816 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.894072 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f507543-c89d-4ab8-ba93-76af161d0816 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:21.895625 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f507543-c89d-4ab8-ba93-76af161d0816 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:21.960400 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4f507543-c89d-4ab8-ba93-76af161d0816 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080526 Dec 16 14:41:21.960904 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 123/260] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:41:21 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:21.965321 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-473b2b85-9e98-4ab1-b2b8-59aa187f1d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:21.975724 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-473b2b85-9e98-4ab1-b2b8-59aa187f1d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.229079 Dec 16 14:41:21.976309 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 138/261] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:21 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:22.672770 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ef7b372d-dfed-4085-9523-2befed9f798a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:22.673391 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ef7b372d-dfed-4085-9523-2befed9f798a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:22.681083 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ef7b372d-dfed-4085-9523-2befed9f798a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:22.681525 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ef7b372d-dfed-4085-9523-2befed9f798a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:22.682272 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ef7b372d-dfed-4085-9523-2befed9f798a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:22.682699 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ef7b372d-dfed-4085-9523-2befed9f798a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:22.878412 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ef7b372d-dfed-4085-9523-2befed9f798a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:22.887587 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ef7b372d-dfed-4085-9523-2befed9f798a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:22.888751 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ef7b372d-dfed-4085-9523-2befed9f798a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:22.889908 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ef7b372d-dfed-4085-9523-2befed9f798a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.220830 Dec 16 14:41:22.890471 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 124/262] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:22 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:22.971329 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bc2e61e9-4ffd-4990-a70b-762780b00f45 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:22.972289 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bc2e61e9-4ffd-4990-a70b-762780b00f45 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:22.980036 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc2e61e9-4ffd-4990-a70b-762780b00f45 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:22.980492 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc2e61e9-4ffd-4990-a70b-762780b00f45 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:22.981284 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc2e61e9-4ffd-4990-a70b-762780b00f45 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:22.981716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc2e61e9-4ffd-4990-a70b-762780b00f45 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:22.991880 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7682d11e-6faa-4cb7-91d5-ec2f2c8a75b0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:22.992487 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7682d11e-6faa-4cb7-91d5-ec2f2c8a75b0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:22.999716 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7682d11e-6faa-4cb7-91d5-ec2f2c8a75b0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:23.000197 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7682d11e-6faa-4cb7-91d5-ec2f2c8a75b0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:23.001003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7682d11e-6faa-4cb7-91d5-ec2f2c8a75b0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:23.001439 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7682d11e-6faa-4cb7-91d5-ec2f2c8a75b0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:23.047596 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bc2e61e9-4ffd-4990-a70b-762780b00f45 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079992 Dec 16 14:41:23.048158 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 139/263] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:41:22 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:23.195062 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7682d11e-6faa-4cb7-91d5-ec2f2c8a75b0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:23.203099 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7682d11e-6faa-4cb7-91d5-ec2f2c8a75b0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.215523 Dec 16 14:41:23.203658 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 125/264] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:22 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:23.908243 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-32f5f626-e5e3-4900-9e87-3edcb45db933 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:23.908903 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-32f5f626-e5e3-4900-9e87-3edcb45db933 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:23.916143 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-32f5f626-e5e3-4900-9e87-3edcb45db933 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:23.916591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-32f5f626-e5e3-4900-9e87-3edcb45db933 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:23.917392 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-32f5f626-e5e3-4900-9e87-3edcb45db933 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:23.917827 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-32f5f626-e5e3-4900-9e87-3edcb45db933 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:24.059549 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-be62afd2-607e-4e68-a0d8-5ba6d88d2f63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:24.060876 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-be62afd2-607e-4e68-a0d8-5ba6d88d2f63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:24.068606 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be62afd2-607e-4e68-a0d8-5ba6d88d2f63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:24.069096 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be62afd2-607e-4e68-a0d8-5ba6d88d2f63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:24.069868 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be62afd2-607e-4e68-a0d8-5ba6d88d2f63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:24.070302 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be62afd2-607e-4e68-a0d8-5ba6d88d2f63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:24.107720 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-32f5f626-e5e3-4900-9e87-3edcb45db933 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:24.117082 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-32f5f626-e5e3-4900-9e87-3edcb45db933 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:24.118599 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-32f5f626-e5e3-4900-9e87-3edcb45db933 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:24.119728 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-32f5f626-e5e3-4900-9e87-3edcb45db933 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.215227 Dec 16 14:41:24.120291 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 140/265] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:23 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:24.134472 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-be62afd2-607e-4e68-a0d8-5ba6d88d2f63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078616 Dec 16 14:41:24.134955 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 126/266] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:41:24 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:41:24.219713 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-aa58348e-bed4-4915-81a1-cd3bc4eb3cd9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:24.220444 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-aa58348e-bed4-4915-81a1-cd3bc4eb3cd9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:24.228985 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aa58348e-bed4-4915-81a1-cd3bc4eb3cd9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:24.229434 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aa58348e-bed4-4915-81a1-cd3bc4eb3cd9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:24.230205 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aa58348e-bed4-4915-81a1-cd3bc4eb3cd9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:24.230631 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aa58348e-bed4-4915-81a1-cd3bc4eb3cd9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:24.434833 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-aa58348e-bed4-4915-81a1-cd3bc4eb3cd9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:24.444463 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-aa58348e-bed4-4915-81a1-cd3bc4eb3cd9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.228415 Dec 16 14:41:24.445154 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 141/267] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:24 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:25.138656 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e8d83047-6801-4447-ba8d-06adb82da389 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:25.141002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e8d83047-6801-4447-ba8d-06adb82da389 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:25.148175 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-6a255288-6459-4c62-8b78-bf660b8a472e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:25.149251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-6a255288-6459-4c62-8b78-bf660b8a472e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:25.152752 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8d83047-6801-4447-ba8d-06adb82da389 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:25.153228 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8d83047-6801-4447-ba8d-06adb82da389 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:25.154065 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8d83047-6801-4447-ba8d-06adb82da389 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:25.154496 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8d83047-6801-4447-ba8d-06adb82da389 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:25.165043 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6a255288-6459-4c62-8b78-bf660b8a472e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:25.165495 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6a255288-6459-4c62-8b78-bf660b8a472e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:25.166279 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6a255288-6459-4c62-8b78-bf660b8a472e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:25.166714 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6a255288-6459-4c62-8b78-bf660b8a472e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:25.231695 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-6a255288-6459-4c62-8b78-bf660b8a472e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089405 Dec 16 14:41:25.232175 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 142/268] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:41:25 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:41:25.360298 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e8d83047-6801-4447-ba8d-06adb82da389 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:25.369713 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e8d83047-6801-4447-ba8d-06adb82da389 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:25.371237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e8d83047-6801-4447-ba8d-06adb82da389 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:25.372352 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e8d83047-6801-4447-ba8d-06adb82da389 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.237494 Dec 16 14:41:25.372930 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 127/269] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:25 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:25.460485 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-6338efa3-6a42-41d7-800a-f95486e8c3aa tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:25.461122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-6338efa3-6a42-41d7-800a-f95486e8c3aa tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:25.468109 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6338efa3-6a42-41d7-800a-f95486e8c3aa tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:25.468552 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6338efa3-6a42-41d7-800a-f95486e8c3aa tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:25.469344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6338efa3-6a42-41d7-800a-f95486e8c3aa tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:25.469778 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6338efa3-6a42-41d7-800a-f95486e8c3aa tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:25.679145 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6338efa3-6a42-41d7-800a-f95486e8c3aa tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:25.687599 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-6338efa3-6a42-41d7-800a-f95486e8c3aa tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.230796 Dec 16 14:41:25.688339 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 143/270] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:25 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:25.972379 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-82bb4792-839f-41ea-997c-0f446abc635f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:25.973403 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-82bb4792-839f-41ea-997c-0f446abc635f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:25.980623 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-82bb4792-839f-41ea-997c-0f446abc635f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:25.981109 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-82bb4792-839f-41ea-997c-0f446abc635f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:25.981877 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-82bb4792-839f-41ea-997c-0f446abc635f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:25.982303 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-82bb4792-839f-41ea-997c-0f446abc635f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.039514 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-82bb4792-839f-41ea-997c-0f446abc635f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lazy-loading 'flavor' on Instance uuid 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:41:26.243582 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-390739c5-69ab-4eae-891a-beac550f7d48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:26.244533 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-390739c5-69ab-4eae-891a-beac550f7d48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:26.255231 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-390739c5-69ab-4eae-891a-beac550f7d48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.256179 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-390739c5-69ab-4eae-891a-beac550f7d48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.258714 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-390739c5-69ab-4eae-891a-beac550f7d48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.259443 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-390739c5-69ab-4eae-891a-beac550f7d48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.286731 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-82bb4792-839f-41ea-997c-0f446abc635f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/action" status: 200 len: 32 microversion: 2.1 time: 0.318165 Dec 16 14:41:26.291448 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 128/271] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:41:25 2021] POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/action => generated 32 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:41:26.296801 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5f8fd074-6a03-457d-939e-2502ce747e90 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:26.297506 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5f8fd074-6a03-457d-939e-2502ce747e90 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:26.310340 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f8fd074-6a03-457d-939e-2502ce747e90 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.311233 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f8fd074-6a03-457d-939e-2502ce747e90 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.312183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f8fd074-6a03-457d-939e-2502ce747e90 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.312659 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f8fd074-6a03-457d-939e-2502ce747e90 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.351985 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-390739c5-69ab-4eae-891a-beac550f7d48 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112153 Dec 16 14:41:26.353162 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 144/272] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:41:26 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:41:26.396730 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9f77ef91-e6a2-488f-8eb6-c22b6e60b4ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:26.397918 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9f77ef91-e6a2-488f-8eb6-c22b6e60b4ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:26.412589 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9f77ef91-e6a2-488f-8eb6-c22b6e60b4ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.413066 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9f77ef91-e6a2-488f-8eb6-c22b6e60b4ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.414106 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9f77ef91-e6a2-488f-8eb6-c22b6e60b4ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.414733 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9f77ef91-e6a2-488f-8eb6-c22b6e60b4ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.602111 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5f8fd074-6a03-457d-939e-2502ce747e90 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:26.612158 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5f8fd074-6a03-457d-939e-2502ce747e90 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.319386 Dec 16 14:41:26.612741 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 129/273] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:26 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:26.686276 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9f77ef91-e6a2-488f-8eb6-c22b6e60b4ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:26.695336 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9f77ef91-e6a2-488f-8eb6-c22b6e60b4ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:26.696809 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9f77ef91-e6a2-488f-8eb6-c22b6e60b4ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:26.697944 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9f77ef91-e6a2-488f-8eb6-c22b6e60b4ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.309909 Dec 16 14:41:26.700022 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 145/274] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:26 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:26.713288 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e42bdf17-d6da-4f4d-a784-747d2386b152 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:26.713889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e42bdf17-d6da-4f4d-a784-747d2386b152 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:26.721461 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e42bdf17-d6da-4f4d-a784-747d2386b152 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.722128 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e42bdf17-d6da-4f4d-a784-747d2386b152 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.723396 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e42bdf17-d6da-4f4d-a784-747d2386b152 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:26.723819 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e42bdf17-d6da-4f4d-a784-747d2386b152 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:26.937982 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e42bdf17-d6da-4f4d-a784-747d2386b152 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:26.952100 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e42bdf17-d6da-4f4d-a784-747d2386b152 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.242240 Dec 16 14:41:26.953058 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 130/275] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:26 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:27.363813 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4ae7b488-f34b-4249-b1de-7111c9bc8c9a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:27.364859 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4ae7b488-f34b-4249-b1de-7111c9bc8c9a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:27.372337 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4ae7b488-f34b-4249-b1de-7111c9bc8c9a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:27.372806 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4ae7b488-f34b-4249-b1de-7111c9bc8c9a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:27.373604 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4ae7b488-f34b-4249-b1de-7111c9bc8c9a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:27.374042 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4ae7b488-f34b-4249-b1de-7111c9bc8c9a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:27.443111 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4ae7b488-f34b-4249-b1de-7111c9bc8c9a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083346 Dec 16 14:41:27.443692 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 146/276] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:41:27 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:41:27.632433 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f3c4b6ff-4bd0-4748-b3b6-cbb422fac054 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:27.633199 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f3c4b6ff-4bd0-4748-b3b6-cbb422fac054 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:27.640659 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f3c4b6ff-4bd0-4748-b3b6-cbb422fac054 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:27.641315 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f3c4b6ff-4bd0-4748-b3b6-cbb422fac054 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:27.642699 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f3c4b6ff-4bd0-4748-b3b6-cbb422fac054 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:27.643395 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f3c4b6ff-4bd0-4748-b3b6-cbb422fac054 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:27.678739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-431500669", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "networks": [{"uuid": "80a0dcd7-59dc-485e-9feb-7d18fa3c28f8"}]}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:27.760809 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.network.neutron [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] validate_networks() for [('80a0dcd7-59dc-485e-9feb-7d18fa3c28f8', None, None, None)] {{(pid=101914) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:41:28.052227 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f3c4b6ff-4bd0-4748-b3b6-cbb422fac054 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:28.061129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f3c4b6ff-4bd0-4748-b3b6-cbb422fac054 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.432594 Dec 16 14:41:28.061712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 131/277] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:27 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:28.073935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f13f49ab-84e1-45ee-a729-7f61a71b1589 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:28.075128 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f13f49ab-84e1-45ee-a729-7f61a71b1589 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:28.083167 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f13f49ab-84e1-45ee-a729-7f61a71b1589 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:28.083884 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f13f49ab-84e1-45ee-a729-7f61a71b1589 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:28.084901 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f13f49ab-84e1-45ee-a729-7f61a71b1589 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:28.085571 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f13f49ab-84e1-45ee-a729-7f61a71b1589 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:28.481239 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f13f49ab-84e1-45ee-a729-7f61a71b1589 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:28.490386 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f13f49ab-84e1-45ee-a729-7f61a71b1589 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:28.491881 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f13f49ab-84e1-45ee-a729-7f61a71b1589 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:28.493015 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f13f49ab-84e1-45ee-a729-7f61a71b1589 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.429869 Dec 16 14:41:28.493575 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 132/278] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:28 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:28.497819 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-46e5e80d-b114-4113-9072-f8ce137da119 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:28.498434 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-46e5e80d-b114-4113-9072-f8ce137da119 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:28.506046 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-46e5e80d-b114-4113-9072-f8ce137da119 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:28.506486 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-46e5e80d-b114-4113-9072-f8ce137da119 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:28.507255 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-46e5e80d-b114-4113-9072-f8ce137da119 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:28.507682 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-46e5e80d-b114-4113-9072-f8ce137da119 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:28.517645 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Flavor limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:41:28.518093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Image limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:41:28.518649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Flavor pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:41:28.519389 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Image pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:41:28.519866 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:41:28.528196 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:28.528723 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:28.529638 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:28.530146 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:28.547359 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Getting quotas for project 5a10c6d1e7e7425bb59f6efad4231db3. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:41:28.551833 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Getting quotas for user eeb2dde456a8408d820d765c54f8a868 and project 5a10c6d1e7e7425bb59f6efad4231db3. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:41:28.562270 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Going to run 1 instances... {{(pid=101914) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:41:28.564569 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:41:28.609271 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f31df079-ca1f-4adf-90d4-efb88aa48741 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934052 Dec 16 14:41:28.610207 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 147/279] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:41:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 16 14:41:28.620294 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-13036866-a675-49cd-9f49-6d03490949de tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:28.620927 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-13036866-a675-49cd-9f49-6d03490949de tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:28.707404 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-13036866-a675-49cd-9f49-6d03490949de tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:28.716998 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-13036866-a675-49cd-9f49-6d03490949de tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1217 microversion: 2.1 time: 0.100188 Dec 16 14:41:28.717867 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 148/280] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:28 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:28.747743 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-46e5e80d-b114-4113-9072-f8ce137da119 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:28.756228 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-46e5e80d-b114-4113-9072-f8ce137da119 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.261642 Dec 16 14:41:28.756803 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 133/281] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:28 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:29.077795 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e076bbd3-e18f-4d51-a334-e90d721eb3d2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:29.078403 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e076bbd3-e18f-4d51-a334-e90d721eb3d2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:29.086477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e076bbd3-e18f-4d51-a334-e90d721eb3d2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.086919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e076bbd3-e18f-4d51-a334-e90d721eb3d2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.087851 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e076bbd3-e18f-4d51-a334-e90d721eb3d2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.088289 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e076bbd3-e18f-4d51-a334-e90d721eb3d2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.293111 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e076bbd3-e18f-4d51-a334-e90d721eb3d2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:29.302272 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e076bbd3-e18f-4d51-a334-e90d721eb3d2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.228291 Dec 16 14:41:29.302834 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 149/282] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:29 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:29.511311 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2cf7902c-01fb-4d77-8606-46deafd98693 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:29.511927 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2cf7902c-01fb-4d77-8606-46deafd98693 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:29.519331 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2cf7902c-01fb-4d77-8606-46deafd98693 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.519779 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2cf7902c-01fb-4d77-8606-46deafd98693 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.520545 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2cf7902c-01fb-4d77-8606-46deafd98693 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.521017 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2cf7902c-01fb-4d77-8606-46deafd98693 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.714128 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2cf7902c-01fb-4d77-8606-46deafd98693 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:29.723251 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2cf7902c-01fb-4d77-8606-46deafd98693 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:29.724772 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2cf7902c-01fb-4d77-8606-46deafd98693 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:29.726047 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2cf7902c-01fb-4d77-8606-46deafd98693 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1745 microversion: 2.20 time: 0.219299 Dec 16 14:41:29.726646 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 134/283] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:29 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1745 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:29.733567 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4d700b0b-d1a9-477d-9478-4e52cb16f53b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:29.734184 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4d700b0b-d1a9-477d-9478-4e52cb16f53b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:29.741955 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d700b0b-d1a9-477d-9478-4e52cb16f53b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.742402 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d700b0b-d1a9-477d-9478-4e52cb16f53b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.743171 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d700b0b-d1a9-477d-9478-4e52cb16f53b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.743608 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d700b0b-d1a9-477d-9478-4e52cb16f53b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.772952 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2d6554f8-e656-41a0-b0c0-9d276beba074 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:29.773553 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2d6554f8-e656-41a0-b0c0-9d276beba074 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:29.780626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2d6554f8-e656-41a0-b0c0-9d276beba074 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.781163 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2d6554f8-e656-41a0-b0c0-9d276beba074 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.781920 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2d6554f8-e656-41a0-b0c0-9d276beba074 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:29.782351 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2d6554f8-e656-41a0-b0c0-9d276beba074 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:29.899700 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4d700b0b-d1a9-477d-9478-4e52cb16f53b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:29.915786 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4d700b0b-d1a9-477d-9478-4e52cb16f53b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1269 microversion: 2.1 time: 0.185376 Dec 16 14:41:29.916864 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 150/284] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:29 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1269 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:30.036949 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2d6554f8-e656-41a0-b0c0-9d276beba074 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:30.045501 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2d6554f8-e656-41a0-b0c0-9d276beba074 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.276537 Dec 16 14:41:30.047686 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 135/285] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:29 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:30.319341 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d182a9c4-fc8b-4d19-969c-6f004f95c300 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:30.319943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d182a9c4-fc8b-4d19-969c-6f004f95c300 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:30.327684 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d182a9c4-fc8b-4d19-969c-6f004f95c300 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:30.328595 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d182a9c4-fc8b-4d19-969c-6f004f95c300 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:30.329652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d182a9c4-fc8b-4d19-969c-6f004f95c300 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:30.330373 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d182a9c4-fc8b-4d19-969c-6f004f95c300 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:30.548893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d182a9c4-fc8b-4d19-969c-6f004f95c300 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:30.559924 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d182a9c4-fc8b-4d19-969c-6f004f95c300 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.244646 Dec 16 14:41:30.561187 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 151/286] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:30 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:30.745984 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c948b874-0e76-47c0-91d1-4b6d45624000 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:30.747127 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c948b874-0e76-47c0-91d1-4b6d45624000 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:30.757683 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c948b874-0e76-47c0-91d1-4b6d45624000 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:30.759359 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c948b874-0e76-47c0-91d1-4b6d45624000 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:30.760685 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c948b874-0e76-47c0-91d1-4b6d45624000 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:30.761595 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c948b874-0e76-47c0-91d1-4b6d45624000 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:30.932946 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c6200480-a17d-49dc-8784-7585fbed0efc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:30.934110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c6200480-a17d-49dc-8784-7585fbed0efc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:30.942170 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c6200480-a17d-49dc-8784-7585fbed0efc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:30.942715 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c6200480-a17d-49dc-8784-7585fbed0efc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:30.943508 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c6200480-a17d-49dc-8784-7585fbed0efc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:30.943943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c6200480-a17d-49dc-8784-7585fbed0efc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:30.986768 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c948b874-0e76-47c0-91d1-4b6d45624000 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:30.998472 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c948b874-0e76-47c0-91d1-4b6d45624000 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:31.000443 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c948b874-0e76-47c0-91d1-4b6d45624000 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:31.001848 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c948b874-0e76-47c0-91d1-4b6d45624000 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1745 microversion: 2.20 time: 0.260435 Dec 16 14:41:31.012961 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 136/287] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:30 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1745 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:31.062932 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-76f15519-c66c-486c-ad9b-428f9cfc4511 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:31.063767 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-76f15519-c66c-486c-ad9b-428f9cfc4511 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:31.074220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76f15519-c66c-486c-ad9b-428f9cfc4511 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:31.074674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76f15519-c66c-486c-ad9b-428f9cfc4511 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.075466 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76f15519-c66c-486c-ad9b-428f9cfc4511 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:31.075906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76f15519-c66c-486c-ad9b-428f9cfc4511 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.229249 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c6200480-a17d-49dc-8784-7585fbed0efc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:31.240165 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c6200480-a17d-49dc-8784-7585fbed0efc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.310879 Dec 16 14:41:31.245137 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 152/288] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:30 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:31.335012 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-76f15519-c66c-486c-ad9b-428f9cfc4511 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:31.343316 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-76f15519-c66c-486c-ad9b-428f9cfc4511 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.284357 Dec 16 14:41:31.343882 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 137/289] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:31 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:31.449445 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f9b029d9-1fc8-4b13-a805-30b12d3d078e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81d487c8-09b9-4441-b6b0-761c85c98358", "device": "/dev/sdb"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:31.451144 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f9b029d9-1fc8-4b13-a805-30b12d3d078e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:31.459317 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f9b029d9-1fc8-4b13-a805-30b12d3d078e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:31.459769 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f9b029d9-1fc8-4b13-a805-30b12d3d078e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.460557 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f9b029d9-1fc8-4b13-a805-30b12d3d078e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:31.461019 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f9b029d9-1fc8-4b13-a805-30b12d3d078e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.577235 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6ea4f456-187e-439d-84ce-d159d4e42ad3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:31.577978 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6ea4f456-187e-439d-84ce-d159d4e42ad3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:31.587421 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6ea4f456-187e-439d-84ce-d159d4e42ad3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:31.587878 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6ea4f456-187e-439d-84ce-d159d4e42ad3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.588915 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6ea4f456-187e-439d-84ce-d159d4e42ad3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:31.589352 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6ea4f456-187e-439d-84ce-d159d4e42ad3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:31.901224 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6ea4f456-187e-439d-84ce-d159d4e42ad3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:31.913881 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6ea4f456-187e-439d-84ce-d159d4e42ad3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.340155 Dec 16 14:41:31.915020 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 138/290] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:31 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:31.938883 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f9b029d9-1fc8-4b13-a805-30b12d3d078e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "POST /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.493109 Dec 16 14:41:31.940169 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 153/291] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:41:31 2021] POST /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:32.020808 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-41aae2bd-3d5a-4de7-981d-0e1acbee63dc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:32.021441 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-41aae2bd-3d5a-4de7-981d-0e1acbee63dc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:32.042686 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-41aae2bd-3d5a-4de7-981d-0e1acbee63dc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.043349 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-41aae2bd-3d5a-4de7-981d-0e1acbee63dc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.045516 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-41aae2bd-3d5a-4de7-981d-0e1acbee63dc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.046169 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-41aae2bd-3d5a-4de7-981d-0e1acbee63dc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.262838 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-199afe74-ea3d-4494-bee5-5b4a15694663 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:32.264082 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-199afe74-ea3d-4494-bee5-5b4a15694663 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:32.290152 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-199afe74-ea3d-4494-bee5-5b4a15694663 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.291068 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-199afe74-ea3d-4494-bee5-5b4a15694663 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.292084 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-199afe74-ea3d-4494-bee5-5b4a15694663 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.295093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-199afe74-ea3d-4494-bee5-5b4a15694663 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.336274 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-41aae2bd-3d5a-4de7-981d-0e1acbee63dc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:32.356628 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-41aae2bd-3d5a-4de7-981d-0e1acbee63dc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:32.358621 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-41aae2bd-3d5a-4de7-981d-0e1acbee63dc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:32.360009 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-41aae2bd-3d5a-4de7-981d-0e1acbee63dc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1745 microversion: 2.20 time: 0.344119 Dec 16 14:41:32.372243 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 139/292] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:32 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1745 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:32.377852 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-09850cfa-6749-4c96-ae04-6329c10483f2 req-2e4f6486-1094-4c41-b1d0-7c5b89b947cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a5a09b-6a73-4b0e-accc-7d9eb35ef787", "tag": "53319b19-0957-4d2a-bc97-feaecba46759"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:32.380211 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:32.380211 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:41:32.391580 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-09850cfa-6749-4c96-ae04-6329c10483f2 req-2e4f6486-1094-4c41-b1d0-7c5b89b947cc service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.392327 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-09850cfa-6749-4c96-ae04-6329c10483f2 req-2e4f6486-1094-4c41-b1d0-7c5b89b947cc service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.413356 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-09850cfa-6749-4c96-ae04-6329c10483f2 req-2e4f6486-1094-4c41-b1d0-7c5b89b947cc service nova] Creating event network-changed:53319b19-0957-4d2a-bc97-feaecba46759 for instance 25a5a09b-6a73-4b0e-accc-7d9eb35ef787 on hv-cinder-82189 Dec 16 14:41:32.419312 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-09850cfa-6749-4c96-ae04-6329c10483f2 req-2e4f6486-1094-4c41-b1d0-7c5b89b947cc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056462 Dec 16 14:41:32.420843 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 140/293] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:32.426796 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-dff2d037-22a0-470c-9cd1-fa807417c479 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:32.429347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-dff2d037-22a0-470c-9cd1-fa807417c479 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:32.439587 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dff2d037-22a0-470c-9cd1-fa807417c479 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.440050 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dff2d037-22a0-470c-9cd1-fa807417c479 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.441056 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dff2d037-22a0-470c-9cd1-fa807417c479 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.442188 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dff2d037-22a0-470c-9cd1-fa807417c479 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.755737 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-dff2d037-22a0-470c-9cd1-fa807417c479 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:32.758367 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-199afe74-ea3d-4494-bee5-5b4a15694663 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:32.765549 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-dff2d037-22a0-470c-9cd1-fa807417c479 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.342491 Dec 16 14:41:32.774669 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 141/294] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:32 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:32.774669 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-44e88eaf-0482-41d0-bc2f-80e9fb53038b req-c432333f-8a80-4deb-9af3-a6165ee3a51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d908e8-0282-46b4-939d-5b760dc9bda7", "name": "network-vif-plugged", "status": "completed", "tag": "e5a5d4f3-fc09-4d64-b8ed-0a6eb24a6766"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:32.774669 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:32.774669 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:41:32.775100 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-199afe74-ea3d-4494-bee5-5b4a15694663 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.516779 Dec 16 14:41:32.775857 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 154/295] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:32 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:32.781546 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-44e88eaf-0482-41d0-bc2f-80e9fb53038b req-c432333f-8a80-4deb-9af3-a6165ee3a51d service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.781980 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-44e88eaf-0482-41d0-bc2f-80e9fb53038b req-c432333f-8a80-4deb-9af3-a6165ee3a51d service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.799737 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-44e88eaf-0482-41d0-bc2f-80e9fb53038b req-c432333f-8a80-4deb-9af3-a6165ee3a51d service nova] Creating event network-vif-plugged:e5a5d4f3-fc09-4d64-b8ed-0a6eb24a6766 for instance 26d908e8-0282-46b4-939d-5b760dc9bda7 on hv-cinder-82189 Dec 16 14:41:32.805383 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-44e88eaf-0482-41d0-bc2f-80e9fb53038b req-c432333f-8a80-4deb-9af3-a6165ee3a51d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037764 Dec 16 14:41:32.806032 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 142/296] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:32.931912 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-34095883-9242-45e9-8757-06083979426c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:32.932632 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-34095883-9242-45e9-8757-06083979426c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:32.940142 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34095883-9242-45e9-8757-06083979426c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.941436 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34095883-9242-45e9-8757-06083979426c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:32.942288 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34095883-9242-45e9-8757-06083979426c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:32.942924 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34095883-9242-45e9-8757-06083979426c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.160129 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-34095883-9242-45e9-8757-06083979426c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:33.168878 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-34095883-9242-45e9-8757-06083979426c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.241110 Dec 16 14:41:33.169435 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 155/297] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:32 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:33.381079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c25dfcc3-8791-44e3-83fe-4136e0917ea6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:33.381770 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c25dfcc3-8791-44e3-83fe-4136e0917ea6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:33.389735 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c25dfcc3-8791-44e3-83fe-4136e0917ea6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.390182 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c25dfcc3-8791-44e3-83fe-4136e0917ea6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.390950 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c25dfcc3-8791-44e3-83fe-4136e0917ea6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.391378 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c25dfcc3-8791-44e3-83fe-4136e0917ea6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.596194 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c25dfcc3-8791-44e3-83fe-4136e0917ea6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:33.604817 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c25dfcc3-8791-44e3-83fe-4136e0917ea6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:33.606325 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c25dfcc3-8791-44e3-83fe-4136e0917ea6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:33.607736 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c25dfcc3-8791-44e3-83fe-4136e0917ea6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1745 microversion: 2.20 time: 0.231615 Dec 16 14:41:33.608557 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 143/298] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:33 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1745 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:33.782110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-66a946f4-4580-4099-921b-90780cd681db tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:33.782742 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-66a946f4-4580-4099-921b-90780cd681db tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:33.790322 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-66a946f4-4580-4099-921b-90780cd681db tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.790769 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-66a946f4-4580-4099-921b-90780cd681db tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.790891 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1ed8e977-d549-41e8-9ad6-9f7d1116ac17 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:33.791388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1ed8e977-d549-41e8-9ad6-9f7d1116ac17 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:33.791535 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-66a946f4-4580-4099-921b-90780cd681db tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.792025 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-66a946f4-4580-4099-921b-90780cd681db tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.798999 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1ed8e977-d549-41e8-9ad6-9f7d1116ac17 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.799465 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1ed8e977-d549-41e8-9ad6-9f7d1116ac17 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:33.800256 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1ed8e977-d549-41e8-9ad6-9f7d1116ac17 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:33.801214 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1ed8e977-d549-41e8-9ad6-9f7d1116ac17 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:34.416353 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1ed8e977-d549-41e8-9ad6-9f7d1116ac17 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:34.439660 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1ed8e977-d549-41e8-9ad6-9f7d1116ac17 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.651201 Dec 16 14:41:34.449693 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-66a946f4-4580-4099-921b-90780cd681db tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:34.453104 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 144/299] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:33 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:34.461200 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6cdff612-c758-4186-a570-6ffcb0e58b5b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:34.461877 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6cdff612-c758-4186-a570-6ffcb0e58b5b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:34.464683 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-66a946f4-4580-4099-921b-90780cd681db tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1314 microversion: 2.1 time: 0.686200 Dec 16 14:41:34.474383 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 156/300] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:33 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:34.474582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6cdff612-c758-4186-a570-6ffcb0e58b5b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:34.474582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6cdff612-c758-4186-a570-6ffcb0e58b5b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:34.474582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6cdff612-c758-4186-a570-6ffcb0e58b5b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:34.474582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6cdff612-c758-4186-a570-6ffcb0e58b5b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:34.627801 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e6e4d247-0df3-492b-8f4d-8038fe0b1bfa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:34.628515 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e6e4d247-0df3-492b-8f4d-8038fe0b1bfa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:34.639202 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6e4d247-0df3-492b-8f4d-8038fe0b1bfa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:34.639981 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6e4d247-0df3-492b-8f4d-8038fe0b1bfa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:34.641281 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6e4d247-0df3-492b-8f4d-8038fe0b1bfa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:34.641901 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6e4d247-0df3-492b-8f4d-8038fe0b1bfa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:34.825956 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6cdff612-c758-4186-a570-6ffcb0e58b5b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:34.835608 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6cdff612-c758-4186-a570-6ffcb0e58b5b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.382387 Dec 16 14:41:34.836200 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 145/301] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:34 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:34.851453 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-f66a80f4-d1da-43a3-9cb3-c0aa71676f8c req-87bffcb9-d51d-43ac-9abc-8682271c2add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e7a3c6-dc99-4927-83c2-dd8ba87239b2", "name": "network-vif-plugged", "status": "completed", "tag": "3086416d-8f44-45e7-a877-073ca8530605"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:34.853909 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:34.853909 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:41:34.862286 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-f66a80f4-d1da-43a3-9cb3-c0aa71676f8c req-87bffcb9-d51d-43ac-9abc-8682271c2add service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:34.863456 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-f66a80f4-d1da-43a3-9cb3-c0aa71676f8c req-87bffcb9-d51d-43ac-9abc-8682271c2add service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:34.882501 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-f66a80f4-d1da-43a3-9cb3-c0aa71676f8c req-87bffcb9-d51d-43ac-9abc-8682271c2add service nova] Creating event network-vif-plugged:3086416d-8f44-45e7-a877-073ca8530605 for instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 on hv-cinder-82189 Dec 16 14:41:34.887504 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-f66a80f4-d1da-43a3-9cb3-c0aa71676f8c req-87bffcb9-d51d-43ac-9abc-8682271c2add service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050154 Dec 16 14:41:34.888469 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 146/302] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:34.918838 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e6e4d247-0df3-492b-8f4d-8038fe0b1bfa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:34.928069 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e6e4d247-0df3-492b-8f4d-8038fe0b1bfa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:34.929617 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e6e4d247-0df3-492b-8f4d-8038fe0b1bfa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:34.930735 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e6e4d247-0df3-492b-8f4d-8038fe0b1bfa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1740 microversion: 2.20 time: 0.307265 Dec 16 14:41:34.931280 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 157/303] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:34 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:35.464366 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8839ab69-6303-41ed-9ea6-9f4e851451df tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:35.465085 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8839ab69-6303-41ed-9ea6-9f4e851451df tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:35.473783 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8839ab69-6303-41ed-9ea6-9f4e851451df tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:35.485387 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8839ab69-6303-41ed-9ea6-9f4e851451df tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:35.486470 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8839ab69-6303-41ed-9ea6-9f4e851451df tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:35.486921 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8839ab69-6303-41ed-9ea6-9f4e851451df tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:35.487220 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e129570d-3241-4f4a-a4df-966defb3d06b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:35.489320 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e129570d-3241-4f4a-a4df-966defb3d06b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:35.500169 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e129570d-3241-4f4a-a4df-966defb3d06b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:35.500976 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e129570d-3241-4f4a-a4df-966defb3d06b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:35.502220 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e129570d-3241-4f4a-a4df-966defb3d06b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:35.502852 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e129570d-3241-4f4a-a4df-966defb3d06b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:35.892764 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e129570d-3241-4f4a-a4df-966defb3d06b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:35.902433 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e129570d-3241-4f4a-a4df-966defb3d06b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1498 microversion: 2.1 time: 0.422950 Dec 16 14:41:35.904116 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 158/304] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:35 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1498 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:35.908658 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b0a457e1-f7c1-4c68-b431-27ae57d49442 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:35.910001 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b0a457e1-f7c1-4c68-b431-27ae57d49442 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:35.918294 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b0a457e1-f7c1-4c68-b431-27ae57d49442 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:35.919093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b0a457e1-f7c1-4c68-b431-27ae57d49442 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:35.921195 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b0a457e1-f7c1-4c68-b431-27ae57d49442 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:35.921846 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b0a457e1-f7c1-4c68-b431-27ae57d49442 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:36.097698 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8839ab69-6303-41ed-9ea6-9f4e851451df tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:36.109223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8839ab69-6303-41ed-9ea6-9f4e851451df tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.648714 Dec 16 14:41:36.111269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 147/305] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:35 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:36.124626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fa2382ef-d1f4-4440-ba4d-c32f01505ac5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:36.125661 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fa2382ef-d1f4-4440-ba4d-c32f01505ac5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:36.136251 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa2382ef-d1f4-4440-ba4d-c32f01505ac5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:36.137586 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa2382ef-d1f4-4440-ba4d-c32f01505ac5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:36.138398 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa2382ef-d1f4-4440-ba4d-c32f01505ac5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:36.139135 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa2382ef-d1f4-4440-ba4d-c32f01505ac5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:36.210660 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b0a457e1-f7c1-4c68-b431-27ae57d49442 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:36.221056 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b0a457e1-f7c1-4c68-b431-27ae57d49442 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.315632 Dec 16 14:41:36.225487 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 159/306] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:35 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:36.485321 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fa2382ef-d1f4-4440-ba4d-c32f01505ac5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:36.495679 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fa2382ef-d1f4-4440-ba4d-c32f01505ac5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:36.497450 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fa2382ef-d1f4-4440-ba4d-c32f01505ac5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:36.498698 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fa2382ef-d1f4-4440-ba4d-c32f01505ac5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1740 microversion: 2.20 time: 0.386157 Dec 16 14:41:36.499540 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 148/307] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:36 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:37.049358 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-493c8329-512e-4bdb-8160-2643ead50ee1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:37.051168 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-493c8329-512e-4bdb-8160-2643ead50ee1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:37.059345 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-493c8329-512e-4bdb-8160-2643ead50ee1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.062539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-493c8329-512e-4bdb-8160-2643ead50ee1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.063930 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-493c8329-512e-4bdb-8160-2643ead50ee1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.064118 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-493c8329-512e-4bdb-8160-2643ead50ee1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.131083 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-493c8329-512e-4bdb-8160-2643ead50ee1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Going to try to terminate instance {{(pid=101914) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:41:37.137314 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3d001fe0-e508-408b-b5de-bc574392bef3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:37.138347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3d001fe0-e508-408b-b5de-bc574392bef3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:37.146362 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d001fe0-e508-408b-b5de-bc574392bef3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.147105 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d001fe0-e508-408b-b5de-bc574392bef3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.148087 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d001fe0-e508-408b-b5de-bc574392bef3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.148755 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d001fe0-e508-408b-b5de-bc574392bef3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.273584 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-493c8329-512e-4bdb-8160-2643ead50ee1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "DELETE /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 204 len: 0 microversion: 2.1 time: 0.227622 Dec 16 14:41:37.277627 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 160/308] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:41:37 2021] DELETE /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:41:37.281353 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-37349afb-fafd-41d5-8cb9-7d0cf7fc47cf tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:37.282084 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-37349afb-fafd-41d5-8cb9-7d0cf7fc47cf tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:37.293219 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37349afb-fafd-41d5-8cb9-7d0cf7fc47cf tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.294182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37349afb-fafd-41d5-8cb9-7d0cf7fc47cf tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.295302 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37349afb-fafd-41d5-8cb9-7d0cf7fc47cf tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.295824 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37349afb-fafd-41d5-8cb9-7d0cf7fc47cf tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.430612 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-3d001fe0-e508-408b-b5de-bc574392bef3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:37.442380 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3d001fe0-e508-408b-b5de-bc574392bef3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.311500 Dec 16 14:41:37.443271 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 149/309] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:37 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:37.455051 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9e1d9271-1b49-4d1c-b10e-fdf3d034fbb0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:37.455672 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9e1d9271-1b49-4d1c-b10e-fdf3d034fbb0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:37.463229 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9e1d9271-1b49-4d1c-b10e-fdf3d034fbb0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.463683 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9e1d9271-1b49-4d1c-b10e-fdf3d034fbb0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.464589 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9e1d9271-1b49-4d1c-b10e-fdf3d034fbb0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.465065 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9e1d9271-1b49-4d1c-b10e-fdf3d034fbb0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.651371 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-37349afb-fafd-41d5-8cb9-7d0cf7fc47cf tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:37.662622 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-37349afb-fafd-41d5-8cb9-7d0cf7fc47cf tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.386116 Dec 16 14:41:37.673488 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 161/310] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:37 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:37.680574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a33b3be4-fb96-4598-a4c8-0763f61d3141 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:37.681651 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a33b3be4-fb96-4598-a4c8-0763f61d3141 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:37.698912 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a33b3be4-fb96-4598-a4c8-0763f61d3141 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.699420 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a33b3be4-fb96-4598-a4c8-0763f61d3141 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.700388 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a33b3be4-fb96-4598-a4c8-0763f61d3141 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:37.701083 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a33b3be4-fb96-4598-a4c8-0763f61d3141 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:37.795362 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9e1d9271-1b49-4d1c-b10e-fdf3d034fbb0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:37.806633 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9e1d9271-1b49-4d1c-b10e-fdf3d034fbb0 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1504 microversion: 2.1 time: 0.362291 Dec 16 14:41:37.807585 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 150/311] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:37 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:37.996282 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a33b3be4-fb96-4598-a4c8-0763f61d3141 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:38.009134 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a33b3be4-fb96-4598-a4c8-0763f61d3141 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:38.011233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a33b3be4-fb96-4598-a4c8-0763f61d3141 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:38.012819 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a33b3be4-fb96-4598-a4c8-0763f61d3141 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1740 microversion: 2.20 time: 0.338061 Dec 16 14:41:38.013754 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 162/312] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:37 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:38.459755 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6d3ac123-227b-4945-bc4a-8fe1b6764530 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:38.460396 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6d3ac123-227b-4945-bc4a-8fe1b6764530 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:38.467966 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d3ac123-227b-4945-bc4a-8fe1b6764530 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:38.468412 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d3ac123-227b-4945-bc4a-8fe1b6764530 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:38.469220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d3ac123-227b-4945-bc4a-8fe1b6764530 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:38.469654 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d3ac123-227b-4945-bc4a-8fe1b6764530 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:38.688205 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f3c6e976-a6d0-456e-9515-253987fdb18a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:38.689907 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f3c6e976-a6d0-456e-9515-253987fdb18a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:38.698253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3c6e976-a6d0-456e-9515-253987fdb18a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:38.699056 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3c6e976-a6d0-456e-9515-253987fdb18a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:38.700365 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3c6e976-a6d0-456e-9515-253987fdb18a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:38.701041 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3c6e976-a6d0-456e-9515-253987fdb18a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:38.706782 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6d3ac123-227b-4945-bc4a-8fe1b6764530 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:38.722824 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6d3ac123-227b-4945-bc4a-8fe1b6764530 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.265783 Dec 16 14:41:38.732764 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 151/313] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:38 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:38.824916 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7e0ce50f-8423-464f-802b-2b62f0e89b3d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:38.825552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7e0ce50f-8423-464f-802b-2b62f0e89b3d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:38.837622 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e0ce50f-8423-464f-802b-2b62f0e89b3d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:38.838079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e0ce50f-8423-464f-802b-2b62f0e89b3d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:38.838871 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e0ce50f-8423-464f-802b-2b62f0e89b3d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:38.839480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e0ce50f-8423-464f-802b-2b62f0e89b3d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:39.151583 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f3c6e976-a6d0-456e-9515-253987fdb18a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:39.156218 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7e0ce50f-8423-464f-802b-2b62f0e89b3d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:39.161841 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f3c6e976-a6d0-456e-9515-253987fdb18a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.481135 Dec 16 14:41:39.162587 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 163/314] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:38 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:39.170532 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a03838c8-119b-4b68-8501-9a3f4e2e1375 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:39.171369 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a03838c8-119b-4b68-8501-9a3f4e2e1375 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:39.178038 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7e0ce50f-8423-464f-802b-2b62f0e89b3d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1504 microversion: 2.1 time: 0.358141 Dec 16 14:41:39.178778 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 152/315] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:38 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:39.185398 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a03838c8-119b-4b68-8501-9a3f4e2e1375 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:39.186870 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a03838c8-119b-4b68-8501-9a3f4e2e1375 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:39.187965 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a03838c8-119b-4b68-8501-9a3f4e2e1375 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:39.188494 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a03838c8-119b-4b68-8501-9a3f4e2e1375 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:39.422785 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a03838c8-119b-4b68-8501-9a3f4e2e1375 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:39.432874 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a03838c8-119b-4b68-8501-9a3f4e2e1375 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:39.434488 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a03838c8-119b-4b68-8501-9a3f4e2e1375 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:39.443232 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a03838c8-119b-4b68-8501-9a3f4e2e1375 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1740 microversion: 2.20 time: 0.271961 Dec 16 14:41:39.443232 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 164/316] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:39 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:39.742091 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d4e9a6af-df58-485f-ae05-06f60d1f601e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:39.742679 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d4e9a6af-df58-485f-ae05-06f60d1f601e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:39.752023 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d4e9a6af-df58-485f-ae05-06f60d1f601e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:39.752023 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d4e9a6af-df58-485f-ae05-06f60d1f601e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:39.754308 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d4e9a6af-df58-485f-ae05-06f60d1f601e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:39.755093 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d4e9a6af-df58-485f-ae05-06f60d1f601e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:40.123133 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d4e9a6af-df58-485f-ae05-06f60d1f601e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:40.148179 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d4e9a6af-df58-485f-ae05-06f60d1f601e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.411364 Dec 16 14:41:40.151020 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 153/317] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:39 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:40.183126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-432c69bb-6794-4612-84c9-ce83b30387aa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:40.183848 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-432c69bb-6794-4612-84c9-ce83b30387aa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:40.194725 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2f4d281a-2ff6-4dcb-b8c6-fed354faa414 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:40.195442 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2f4d281a-2ff6-4dcb-b8c6-fed354faa414 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:40.210575 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-432c69bb-6794-4612-84c9-ce83b30387aa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:40.213403 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-432c69bb-6794-4612-84c9-ce83b30387aa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:40.214983 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2f4d281a-2ff6-4dcb-b8c6-fed354faa414 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:40.216008 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-432c69bb-6794-4612-84c9-ce83b30387aa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:40.218843 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-432c69bb-6794-4612-84c9-ce83b30387aa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:40.219452 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2f4d281a-2ff6-4dcb-b8c6-fed354faa414 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:40.228647 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2f4d281a-2ff6-4dcb-b8c6-fed354faa414 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:40.229666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2f4d281a-2ff6-4dcb-b8c6-fed354faa414 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.188560 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-432c69bb-6794-4612-84c9-ce83b30387aa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:41.200340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-432c69bb-6794-4612-84c9-ce83b30387aa tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 1.021010 Dec 16 14:41:41.213317 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 165/318] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:40 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:41.220018 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2f4d281a-2ff6-4dcb-b8c6-fed354faa414 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:41.227011 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f333d183-3270-48cf-8c52-30590ed20f9a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:41.227011 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f333d183-3270-48cf-8c52-30590ed20f9a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:41.229340 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2f4d281a-2ff6-4dcb-b8c6-fed354faa414 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1504 microversion: 2.1 time: 1.038240 Dec 16 14:41:41.230738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 154/319] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:40 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1504 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:41.244911 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4e7a864e-c433-4862-a345-daa18ef36476 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:41.245746 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4e7a864e-c433-4862-a345-daa18ef36476 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:41.247070 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f333d183-3270-48cf-8c52-30590ed20f9a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.247515 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f333d183-3270-48cf-8c52-30590ed20f9a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.248291 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f333d183-3270-48cf-8c52-30590ed20f9a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.248726 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f333d183-3270-48cf-8c52-30590ed20f9a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.254214 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e7a864e-c433-4862-a345-daa18ef36476 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.254901 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e7a864e-c433-4862-a345-daa18ef36476 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.257255 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e7a864e-c433-4862-a345-daa18ef36476 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.273130 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e7a864e-c433-4862-a345-daa18ef36476 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.756250 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4e7a864e-c433-4862-a345-daa18ef36476 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:41.757041 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f333d183-3270-48cf-8c52-30590ed20f9a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:41.764825 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4e7a864e-c433-4862-a345-daa18ef36476 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.523718 Dec 16 14:41:41.766792 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f333d183-3270-48cf-8c52-30590ed20f9a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:41.769110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f333d183-3270-48cf-8c52-30590ed20f9a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:41.770553 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f333d183-3270-48cf-8c52-30590ed20f9a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1740 microversion: 2.20 time: 0.568025 Dec 16 14:41:41.771187 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 166/320] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:41 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1740 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:41.774819 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 155/321] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:41 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:41.778046 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-a6372d2c-d3ff-4125-ab64-764cbcd631bc req-d39dc02a-ce23-4a33-bb35-705b4dd10167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d908e8-0282-46b4-939d-5b760dc9bda7", "name": "network-vif-deleted", "tag": "e5a5d4f3-fc09-4d64-b8ed-0a6eb24a6766"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:41.779616 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:41.779616 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:41:41.788393 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-a6372d2c-d3ff-4125-ab64-764cbcd631bc req-d39dc02a-ce23-4a33-bb35-705b4dd10167 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:41.788870 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-a6372d2c-d3ff-4125-ab64-764cbcd631bc req-d39dc02a-ce23-4a33-bb35-705b4dd10167 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:41.806190 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-a6372d2c-d3ff-4125-ab64-764cbcd631bc req-d39dc02a-ce23-4a33-bb35-705b4dd10167 service nova] Creating event network-vif-deleted:e5a5d4f3-fc09-4d64-b8ed-0a6eb24a6766 for instance 26d908e8-0282-46b4-939d-5b760dc9bda7 on hv-cinder-82189 Dec 16 14:41:41.814260 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-a6372d2c-d3ff-4125-ab64-764cbcd631bc req-d39dc02a-ce23-4a33-bb35-705b4dd10167 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041645 Dec 16 14:41:41.815336 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 167/322] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:42.227834 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-acf339f3-2e11-4388-966b-3e3d47b448b8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:42.229291 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-acf339f3-2e11-4388-966b-3e3d47b448b8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:42.238912 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-acf339f3-2e11-4388-966b-3e3d47b448b8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:42.239723 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-acf339f3-2e11-4388-966b-3e3d47b448b8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:42.242528 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-acf339f3-2e11-4388-966b-3e3d47b448b8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:42.242987 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-acf339f3-2e11-4388-966b-3e3d47b448b8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:42.248169 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-dd8fbc02-b8de-4904-be68-f7c3fd38b9c5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:42.252807 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-dd8fbc02-b8de-4904-be68-f7c3fd38b9c5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:42.261331 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd8fbc02-b8de-4904-be68-f7c3fd38b9c5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:42.262103 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd8fbc02-b8de-4904-be68-f7c3fd38b9c5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:42.263109 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd8fbc02-b8de-4904-be68-f7c3fd38b9c5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:42.263735 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd8fbc02-b8de-4904-be68-f7c3fd38b9c5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:42.465822 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-dd8fbc02-b8de-4904-be68-f7c3fd38b9c5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:42.478087 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-dd8fbc02-b8de-4904-be68-f7c3fd38b9c5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1462 microversion: 2.1 time: 0.234259 Dec 16 14:41:42.493286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 168/323] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:42 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1462 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:42.579935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-acf339f3-2e11-4388-966b-3e3d47b448b8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:42.594177 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-acf339f3-2e11-4388-966b-3e3d47b448b8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.369937 Dec 16 14:41:42.604921 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 156/324] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:42 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:42.781459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9349692d-a1da-466e-a0a4-c51f895ca37e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:42.782053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9349692d-a1da-466e-a0a4-c51f895ca37e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:42.791307 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-729ed293-3572-4f97-91ad-f703274afd1f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:42.792348 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-729ed293-3572-4f97-91ad-f703274afd1f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:42.793160 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9349692d-a1da-466e-a0a4-c51f895ca37e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:42.793721 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9349692d-a1da-466e-a0a4-c51f895ca37e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:42.794608 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9349692d-a1da-466e-a0a4-c51f895ca37e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:42.795148 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9349692d-a1da-466e-a0a4-c51f895ca37e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:42.801894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-729ed293-3572-4f97-91ad-f703274afd1f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:42.802567 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-729ed293-3572-4f97-91ad-f703274afd1f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:42.803550 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-729ed293-3572-4f97-91ad-f703274afd1f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:42.804232 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-729ed293-3572-4f97-91ad-f703274afd1f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:43.139340 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-729ed293-3572-4f97-91ad-f703274afd1f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:43.161609 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9349692d-a1da-466e-a0a4-c51f895ca37e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:43.162650 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-729ed293-3572-4f97-91ad-f703274afd1f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:43.164733 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-729ed293-3572-4f97-91ad-f703274afd1f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:43.165962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-729ed293-3572-4f97-91ad-f703274afd1f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1740 microversion: 2.20 time: 0.380101 Dec 16 14:41:43.173576 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9349692d-a1da-466e-a0a4-c51f895ca37e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.395692 Dec 16 14:41:43.176839 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 169/325] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:42 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:43.177682 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 157/326] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:42 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1740 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:43.497101 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-62cac086-9b68-4ba6-a0dc-b64ae8d14b9b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:43.498397 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-62cac086-9b68-4ba6-a0dc-b64ae8d14b9b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:43.509395 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-62cac086-9b68-4ba6-a0dc-b64ae8d14b9b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:43.510227 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-62cac086-9b68-4ba6-a0dc-b64ae8d14b9b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:43.511208 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-62cac086-9b68-4ba6-a0dc-b64ae8d14b9b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:43.511830 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-62cac086-9b68-4ba6-a0dc-b64ae8d14b9b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:43.615169 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a796db58-0d97-4a5b-9fb8-741f33439142 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:43.615780 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a796db58-0d97-4a5b-9fb8-741f33439142 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:43.623755 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a796db58-0d97-4a5b-9fb8-741f33439142 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:43.624582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a796db58-0d97-4a5b-9fb8-741f33439142 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:43.625390 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a796db58-0d97-4a5b-9fb8-741f33439142 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:43.625819 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a796db58-0d97-4a5b-9fb8-741f33439142 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:43.633784 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-62cac086-9b68-4ba6-a0dc-b64ae8d14b9b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:43.643993 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-62cac086-9b68-4ba6-a0dc-b64ae8d14b9b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1299 microversion: 2.1 time: 0.150268 Dec 16 14:41:43.645424 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 170/327] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:43 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:43.879378 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-a796db58-0d97-4a5b-9fb8-741f33439142 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:43.890109 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a796db58-0d97-4a5b-9fb8-741f33439142 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.281884 Dec 16 14:41:43.890901 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 158/328] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:43 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:44.187791 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f88a1f75-e07b-47ba-8072-6bb3ee251e40 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:44.188926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f88a1f75-e07b-47ba-8072-6bb3ee251e40 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:44.190529 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-50a65bd0-b93c-447d-9ab1-7561adca4f19 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:44.191222 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-50a65bd0-b93c-447d-9ab1-7561adca4f19 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:44.197504 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f88a1f75-e07b-47ba-8072-6bb3ee251e40 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.198155 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f88a1f75-e07b-47ba-8072-6bb3ee251e40 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.199244 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f88a1f75-e07b-47ba-8072-6bb3ee251e40 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.199735 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f88a1f75-e07b-47ba-8072-6bb3ee251e40 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.203959 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-50a65bd0-b93c-447d-9ab1-7561adca4f19 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.204410 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-50a65bd0-b93c-447d-9ab1-7561adca4f19 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.205246 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-50a65bd0-b93c-447d-9ab1-7561adca4f19 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.205696 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-50a65bd0-b93c-447d-9ab1-7561adca4f19 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.496498 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f88a1f75-e07b-47ba-8072-6bb3ee251e40 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:44.510642 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f88a1f75-e07b-47ba-8072-6bb3ee251e40 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:44.514769 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f88a1f75-e07b-47ba-8072-6bb3ee251e40 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:44.516506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f88a1f75-e07b-47ba-8072-6bb3ee251e40 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1740 microversion: 2.20 time: 0.336076 Dec 16 14:41:44.517395 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 171/329] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:44 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1740 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:44.538708 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-1aaeaeea-b893-4309-80dd-4f857dc6159b req-6ee48e87-3129-4cde-bb53-c50a499371b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a5a09b-6a73-4b0e-accc-7d9eb35ef787", "name": "network-vif-plugged", "status": "completed", "tag": "53319b19-0957-4d2a-bc97-feaecba46759"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:44.540333 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:44.540333 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:41:44.564589 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-1aaeaeea-b893-4309-80dd-4f857dc6159b req-6ee48e87-3129-4cde-bb53-c50a499371b6 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.565132 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-1aaeaeea-b893-4309-80dd-4f857dc6159b req-6ee48e87-3129-4cde-bb53-c50a499371b6 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.587779 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-1aaeaeea-b893-4309-80dd-4f857dc6159b req-6ee48e87-3129-4cde-bb53-c50a499371b6 service nova] Creating event network-vif-plugged:53319b19-0957-4d2a-bc97-feaecba46759 for instance 25a5a09b-6a73-4b0e-accc-7d9eb35ef787 on hv-cinder-82189 Dec 16 14:41:44.594355 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-1aaeaeea-b893-4309-80dd-4f857dc6159b req-6ee48e87-3129-4cde-bb53-c50a499371b6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062113 Dec 16 14:41:44.595762 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 172/330] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:44.622928 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-50a65bd0-b93c-447d-9ab1-7561adca4f19 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:44.638207 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-50a65bd0-b93c-447d-9ab1-7561adca4f19 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.451574 Dec 16 14:41:44.639395 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 159/331] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:44 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:44.669487 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:44.670455 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:44.679630 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.680425 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.681587 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.685711 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.795594 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.796198 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.796716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lazy-loading 'fault' on Instance uuid 26d908e8-0282-46b4-939d-5b760dc9bda7 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:41:44.908489 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2e63c2d4-e668-4f96-832c-80e05750aefc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:44.910218 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2e63c2d4-e668-4f96-832c-80e05750aefc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:44.924439 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2e63c2d4-e668-4f96-832c-80e05750aefc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.926122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:44.935980 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2e63c2d4-e668-4f96-832c-80e05750aefc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:44.939046 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0b583439-58a5-4cf2-aef3-a27c99b34474 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 200 len: 1304 microversion: 2.1 time: 0.274332 Dec 16 14:41:44.940876 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 173/332] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:44 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 1304 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:44.942326 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2e63c2d4-e668-4f96-832c-80e05750aefc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:44.942821 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2e63c2d4-e668-4f96-832c-80e05750aefc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:45.365684 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2e63c2d4-e668-4f96-832c-80e05750aefc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:45.374790 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2e63c2d4-e668-4f96-832c-80e05750aefc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.469859 Dec 16 14:41:45.375290 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 160/333] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:44 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:45.535117 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5666bf6e-3821-40fc-bd41-1a2fbe567ddc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:45.535714 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5666bf6e-3821-40fc-bd41-1a2fbe567ddc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:45.542782 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5666bf6e-3821-40fc-bd41-1a2fbe567ddc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:45.543215 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5666bf6e-3821-40fc-bd41-1a2fbe567ddc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:45.543962 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5666bf6e-3821-40fc-bd41-1a2fbe567ddc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:45.544386 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5666bf6e-3821-40fc-bd41-1a2fbe567ddc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:45.655945 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5f0a9d87-c26f-44c7-996e-c321cbcef942 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:45.656566 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5f0a9d87-c26f-44c7-996e-c321cbcef942 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:45.663651 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f0a9d87-c26f-44c7-996e-c321cbcef942 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:45.664102 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f0a9d87-c26f-44c7-996e-c321cbcef942 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:45.664898 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f0a9d87-c26f-44c7-996e-c321cbcef942 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:45.665324 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f0a9d87-c26f-44c7-996e-c321cbcef942 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:45.781458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5666bf6e-3821-40fc-bd41-1a2fbe567ddc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:45.790190 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5666bf6e-3821-40fc-bd41-1a2fbe567ddc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:45.791701 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5666bf6e-3821-40fc-bd41-1a2fbe567ddc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:45.792819 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5666bf6e-3821-40fc-bd41-1a2fbe567ddc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1740 microversion: 2.20 time: 0.261359 Dec 16 14:41:45.793374 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 174/334] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:45 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:45.880183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5f0a9d87-c26f-44c7-996e-c321cbcef942 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:45.888410 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5f0a9d87-c26f-44c7-996e-c321cbcef942 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.236247 Dec 16 14:41:45.888998 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 161/335] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:45 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:45.955264 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b3e00f9c-5dda-4739-b946-ce8f960e8976 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:45.955971 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b3e00f9c-5dda-4739-b946-ce8f960e8976 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: 26d908e8-0282-46b4-939d-5b760dc9bda7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:45.963123 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b3e00f9c-5dda-4739-b946-ce8f960e8976 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:45.963561 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b3e00f9c-5dda-4739-b946-ce8f960e8976 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:45.964309 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b3e00f9c-5dda-4739-b946-ce8f960e8976 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:45.964731 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b3e00f9c-5dda-4739-b946-ce8f960e8976 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.013588 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-b3e00f9c-5dda-4739-b946-ce8f960e8976 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] HTTP exception thrown: Instance 26d908e8-0282-46b4-939d-5b760dc9bda7 could not be found. Dec 16 14:41:46.014179 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b3e00f9c-5dda-4739-b946-ce8f960e8976 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Returning 404 to user: Instance 26d908e8-0282-46b4-939d-5b760dc9bda7 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:41:46.015002 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b3e00f9c-5dda-4739-b946-ce8f960e8976 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7" status: 404 len: 111 microversion: 2.1 time: 0.063467 Dec 16 14:41:46.015543 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 175/336] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:45 2021] GET /compute/v2.1/servers/26d908e8-0282-46b4-939d-5b760dc9bda7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:41:46.067197 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-967176083", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "networks": [{"uuid": "60766b1a-0510-46e5-87ff-a9934f94c446"}]}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:46.132528 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] validate_networks() for [('60766b1a-0510-46e5-87ff-a9934f94c446', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:41:46.394365 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4c7e7fb5-4b1e-4c7a-ba2f-4f0381c86f59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:46.394615 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4c7e7fb5-4b1e-4c7a-ba2f-4f0381c86f59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:46.401802 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c7e7fb5-4b1e-4c7a-ba2f-4f0381c86f59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.402312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c7e7fb5-4b1e-4c7a-ba2f-4f0381c86f59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.403093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c7e7fb5-4b1e-4c7a-ba2f-4f0381c86f59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.403530 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c7e7fb5-4b1e-4c7a-ba2f-4f0381c86f59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.671811 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:41:46.672885 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:41:46.673378 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:41:46.673968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:41:46.674209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:41:46.684955 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.685569 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.686385 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.686812 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.704523 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Getting quotas for project 3a0a8f8b2ba340f1b5d3aacb9646f676. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:41:46.709165 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Getting quotas for user 2a4047bb1e8e42099d2263ee1322450d and project 3a0a8f8b2ba340f1b5d3aacb9646f676. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:41:46.721777 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:41:46.724169 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:41:46.730256 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4c7e7fb5-4b1e-4c7a-ba2f-4f0381c86f59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:46.738978 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4c7e7fb5-4b1e-4c7a-ba2f-4f0381c86f59 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.350090 Dec 16 14:41:46.739543 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 176/337] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:46 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:46.766515 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-bd20c0d4-b043-48cf-a301-c445b5f6cef9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703025 Dec 16 14:41:46.767471 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 162/338] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:41:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:41:46.779011 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-886b0f82-8ae1-40a6-9f6c-53f74fa243df tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:46.779602 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-886b0f82-8ae1-40a6-9f6c-53f74fa243df tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:46.811826 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-572685f0-c743-4566-8e36-8cc11d55fa56 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:46.812729 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-572685f0-c743-4566-8e36-8cc11d55fa56 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:46.822944 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-572685f0-c743-4566-8e36-8cc11d55fa56 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.823795 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-572685f0-c743-4566-8e36-8cc11d55fa56 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.824660 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-572685f0-c743-4566-8e36-8cc11d55fa56 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.825313 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-572685f0-c743-4566-8e36-8cc11d55fa56 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.856122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-886b0f82-8ae1-40a6-9f6c-53f74fa243df tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:46.863837 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-886b0f82-8ae1-40a6-9f6c-53f74fa243df tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1213 microversion: 2.1 time: 0.088493 Dec 16 14:41:46.874079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 177/339] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:46 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:46.910236 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2361e3a5-26e0-491c-b43c-058d1b2e380d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:46.910861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2361e3a5-26e0-491c-b43c-058d1b2e380d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:46.919242 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2361e3a5-26e0-491c-b43c-058d1b2e380d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.919577 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2361e3a5-26e0-491c-b43c-058d1b2e380d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:46.920381 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2361e3a5-26e0-491c-b43c-058d1b2e380d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:46.920837 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2361e3a5-26e0-491c-b43c-058d1b2e380d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:47.096766 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-572685f0-c743-4566-8e36-8cc11d55fa56 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:47.106468 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-572685f0-c743-4566-8e36-8cc11d55fa56 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:47.108005 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-572685f0-c743-4566-8e36-8cc11d55fa56 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:47.109238 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-572685f0-c743-4566-8e36-8cc11d55fa56 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1740 microversion: 2.20 time: 0.301845 Dec 16 14:41:47.109770 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 163/340] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:46 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:47.172734 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2361e3a5-26e0-491c-b43c-058d1b2e380d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:47.181600 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2361e3a5-26e0-491c-b43c-058d1b2e380d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.279672 Dec 16 14:41:47.182161 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 178/341] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:46 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:47.755783 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6d561a8a-1fe7-42e9-83eb-7ea75ea25892 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:47.756401 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6d561a8a-1fe7-42e9-83eb-7ea75ea25892 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:47.763655 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d561a8a-1fe7-42e9-83eb-7ea75ea25892 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:47.764110 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d561a8a-1fe7-42e9-83eb-7ea75ea25892 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:47.764923 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d561a8a-1fe7-42e9-83eb-7ea75ea25892 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:47.765367 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d561a8a-1fe7-42e9-83eb-7ea75ea25892 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:47.881609 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-52fbe385-a521-44ca-b6fb-62566808b704 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:47.882266 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-52fbe385-a521-44ca-b6fb-62566808b704 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:47.890122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-52fbe385-a521-44ca-b6fb-62566808b704 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:47.890569 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-52fbe385-a521-44ca-b6fb-62566808b704 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:47.891336 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-52fbe385-a521-44ca-b6fb-62566808b704 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:47.891763 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-52fbe385-a521-44ca-b6fb-62566808b704 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:47.962962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6d561a8a-1fe7-42e9-83eb-7ea75ea25892 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:47.971577 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6d561a8a-1fe7-42e9-83eb-7ea75ea25892 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.220098 Dec 16 14:41:47.972160 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 164/342] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:47 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:48.007401 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-52fbe385-a521-44ca-b6fb-62566808b704 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:48.015354 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-52fbe385-a521-44ca-b6fb-62566808b704 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1217 microversion: 2.1 time: 0.138331 Dec 16 14:41:48.015899 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 179/343] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:47 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:48.127489 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7e75cd33-1319-4258-8fbe-b01c95c2387a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:48.128092 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7e75cd33-1319-4258-8fbe-b01c95c2387a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:48.135502 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e75cd33-1319-4258-8fbe-b01c95c2387a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:48.135890 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e75cd33-1319-4258-8fbe-b01c95c2387a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:48.136653 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e75cd33-1319-4258-8fbe-b01c95c2387a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:48.137120 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e75cd33-1319-4258-8fbe-b01c95c2387a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:48.200012 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c84c4cf5-6038-4571-a3a6-901540472d50 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:48.200610 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c84c4cf5-6038-4571-a3a6-901540472d50 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:48.208418 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c84c4cf5-6038-4571-a3a6-901540472d50 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:48.208889 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c84c4cf5-6038-4571-a3a6-901540472d50 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:48.209670 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c84c4cf5-6038-4571-a3a6-901540472d50 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:48.210106 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c84c4cf5-6038-4571-a3a6-901540472d50 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:48.392329 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7e75cd33-1319-4258-8fbe-b01c95c2387a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:48.401831 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7e75cd33-1319-4258-8fbe-b01c95c2387a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:48.403318 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7e75cd33-1319-4258-8fbe-b01c95c2387a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:48.404415 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7e75cd33-1319-4258-8fbe-b01c95c2387a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1740 microversion: 2.20 time: 0.280684 Dec 16 14:41:48.404991 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 165/344] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:48 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:48.456588 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c84c4cf5-6038-4571-a3a6-901540472d50 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:48.464983 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c84c4cf5-6038-4571-a3a6-901540472d50 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.268764 Dec 16 14:41:48.465540 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 180/345] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:48 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:48.988845 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-872d390f-c052-4a73-b8d4-908819d6bc88 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:48.989433 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-872d390f-c052-4a73-b8d4-908819d6bc88 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:48.996741 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-872d390f-c052-4a73-b8d4-908819d6bc88 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:48.997229 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-872d390f-c052-4a73-b8d4-908819d6bc88 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:48.998009 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-872d390f-c052-4a73-b8d4-908819d6bc88 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:48.998445 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-872d390f-c052-4a73-b8d4-908819d6bc88 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.032046 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-942cfa9d-1ad5-4c3c-b6da-4863daf0d3da tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:49.032657 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-942cfa9d-1ad5-4c3c-b6da-4863daf0d3da tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:49.040248 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-942cfa9d-1ad5-4c3c-b6da-4863daf0d3da tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.040704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-942cfa9d-1ad5-4c3c-b6da-4863daf0d3da tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.041509 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-942cfa9d-1ad5-4c3c-b6da-4863daf0d3da tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.041945 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-942cfa9d-1ad5-4c3c-b6da-4863daf0d3da tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.169480 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-942cfa9d-1ad5-4c3c-b6da-4863daf0d3da tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:49.179280 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-942cfa9d-1ad5-4c3c-b6da-4863daf0d3da tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1265 microversion: 2.1 time: 0.150865 Dec 16 14:41:49.179861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 181/346] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:49 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:49.246948 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-872d390f-c052-4a73-b8d4-908819d6bc88 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:49.256912 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-872d390f-c052-4a73-b8d4-908819d6bc88 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.272092 Dec 16 14:41:49.257480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 166/347] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:48 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:49.422657 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2f004ad4-f77e-4f59-8d13-9c1c7ac4d945 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:49.423297 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2f004ad4-f77e-4f59-8d13-9c1c7ac4d945 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:49.431157 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2f004ad4-f77e-4f59-8d13-9c1c7ac4d945 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.431610 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2f004ad4-f77e-4f59-8d13-9c1c7ac4d945 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.432772 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2f004ad4-f77e-4f59-8d13-9c1c7ac4d945 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.433382 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2f004ad4-f77e-4f59-8d13-9c1c7ac4d945 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.481426 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6a2d020c-ad1b-48cf-91f8-00fd08013f8b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:49.482663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6a2d020c-ad1b-48cf-91f8-00fd08013f8b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:49.490207 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6a2d020c-ad1b-48cf-91f8-00fd08013f8b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.490868 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6a2d020c-ad1b-48cf-91f8-00fd08013f8b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.491641 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6a2d020c-ad1b-48cf-91f8-00fd08013f8b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:49.492202 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6a2d020c-ad1b-48cf-91f8-00fd08013f8b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:49.843004 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2f004ad4-f77e-4f59-8d13-9c1c7ac4d945 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:49.858649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2f004ad4-f77e-4f59-8d13-9c1c7ac4d945 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:49.866663 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2f004ad4-f77e-4f59-8d13-9c1c7ac4d945 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:49.868068 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2f004ad4-f77e-4f59-8d13-9c1c7ac4d945 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1722 microversion: 2.20 time: 0.449317 Dec 16 14:41:49.869169 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 182/348] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:49 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:49.898373 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6a2d020c-ad1b-48cf-91f8-00fd08013f8b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:49.909117 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6a2d020c-ad1b-48cf-91f8-00fd08013f8b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1317 microversion: 2.1 time: 0.431112 Dec 16 14:41:49.936677 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 167/349] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:49 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:50.196099 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-70512298-6c44-4cb6-ad6d-30d3f5b8cf55 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:50.197412 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-70512298-6c44-4cb6-ad6d-30d3f5b8cf55 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:50.207784 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-70512298-6c44-4cb6-ad6d-30d3f5b8cf55 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:50.208739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-70512298-6c44-4cb6-ad6d-30d3f5b8cf55 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:50.210991 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-70512298-6c44-4cb6-ad6d-30d3f5b8cf55 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:50.211564 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-70512298-6c44-4cb6-ad6d-30d3f5b8cf55 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:50.275848 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-af084b18-e6db-427d-9f83-9864d8168790 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:50.276395 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-af084b18-e6db-427d-9f83-9864d8168790 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:50.286365 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-af084b18-e6db-427d-9f83-9864d8168790 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:50.287154 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-af084b18-e6db-427d-9f83-9864d8168790 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:50.288138 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-af084b18-e6db-427d-9f83-9864d8168790 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:50.288968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-af084b18-e6db-427d-9f83-9864d8168790 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:50.346773 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-70512298-6c44-4cb6-ad6d-30d3f5b8cf55 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:50.355964 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-70512298-6c44-4cb6-ad6d-30d3f5b8cf55 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1271 microversion: 2.1 time: 0.163609 Dec 16 14:41:50.356663 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 183/350] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:50 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:50.496280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-af084b18-e6db-427d-9f83-9864d8168790 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:50.504936 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-af084b18-e6db-427d-9f83-9864d8168790 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.234857 Dec 16 14:41:50.505497 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 168/351] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:50 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:50.886283 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-47b001b0-6d65-4289-aa1c-5f6c1019e99a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:50.886881 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-47b001b0-6d65-4289-aa1c-5f6c1019e99a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:50.895167 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-47b001b0-6d65-4289-aa1c-5f6c1019e99a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:50.895622 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-47b001b0-6d65-4289-aa1c-5f6c1019e99a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:50.896399 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-47b001b0-6d65-4289-aa1c-5f6c1019e99a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:50.896877 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-47b001b0-6d65-4289-aa1c-5f6c1019e99a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:50.926633 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fc35aafb-ff1f-4f1d-9af6-e9ead124c07c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:50.927239 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fc35aafb-ff1f-4f1d-9af6-e9ead124c07c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:50.934370 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fc35aafb-ff1f-4f1d-9af6-e9ead124c07c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:50.934823 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fc35aafb-ff1f-4f1d-9af6-e9ead124c07c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:50.935791 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fc35aafb-ff1f-4f1d-9af6-e9ead124c07c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:50.937281 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fc35aafb-ff1f-4f1d-9af6-e9ead124c07c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:51.186458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-47b001b0-6d65-4289-aa1c-5f6c1019e99a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:51.191432 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fc35aafb-ff1f-4f1d-9af6-e9ead124c07c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:51.195843 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-47b001b0-6d65-4289-aa1c-5f6c1019e99a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:51.197374 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-47b001b0-6d65-4289-aa1c-5f6c1019e99a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:51.198506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-47b001b0-6d65-4289-aa1c-5f6c1019e99a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1722 microversion: 2.20 time: 0.315937 Dec 16 14:41:51.199069 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 184/352] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:50 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:51.199833 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fc35aafb-ff1f-4f1d-9af6-e9ead124c07c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1507 microversion: 2.1 time: 0.276855 Dec 16 14:41:51.200403 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 169/353] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:50 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:51.372994 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-22f9a556-2b5c-448c-bd53-9f7be64c6f16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:51.373601 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-22f9a556-2b5c-448c-bd53-9f7be64c6f16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:51.381702 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-22f9a556-2b5c-448c-bd53-9f7be64c6f16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:51.382203 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-22f9a556-2b5c-448c-bd53-9f7be64c6f16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:51.383110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-22f9a556-2b5c-448c-bd53-9f7be64c6f16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:51.383568 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-22f9a556-2b5c-448c-bd53-9f7be64c6f16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:51.523971 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-219db58b-9d01-47e5-af6e-a8ac1a3773a8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:51.525422 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-219db58b-9d01-47e5-af6e-a8ac1a3773a8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:51.535418 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-219db58b-9d01-47e5-af6e-a8ac1a3773a8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:51.536552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-219db58b-9d01-47e5-af6e-a8ac1a3773a8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:51.537862 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-219db58b-9d01-47e5-af6e-a8ac1a3773a8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:51.538649 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-219db58b-9d01-47e5-af6e-a8ac1a3773a8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:51.593505 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-22f9a556-2b5c-448c-bd53-9f7be64c6f16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:51.605078 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-22f9a556-2b5c-448c-bd53-9f7be64c6f16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.235586 Dec 16 14:41:51.606327 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 185/354] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:51 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:51.756889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-219db58b-9d01-47e5-af6e-a8ac1a3773a8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:51.765523 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-219db58b-9d01-47e5-af6e-a8ac1a3773a8 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.247389 Dec 16 14:41:51.766085 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 170/355] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:51 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:52.216336 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4c8a9d63-52a9-4d20-bbaa-f8c090b8c636 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:52.216869 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4c8a9d63-52a9-4d20-bbaa-f8c090b8c636 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:52.224652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c8a9d63-52a9-4d20-bbaa-f8c090b8c636 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.225125 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c8a9d63-52a9-4d20-bbaa-f8c090b8c636 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.225892 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c8a9d63-52a9-4d20-bbaa-f8c090b8c636 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.226340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c8a9d63-52a9-4d20-bbaa-f8c090b8c636 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.417071 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4c8a9d63-52a9-4d20-bbaa-f8c090b8c636 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:52.425691 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4c8a9d63-52a9-4d20-bbaa-f8c090b8c636 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:52.427199 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4c8a9d63-52a9-4d20-bbaa-f8c090b8c636 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:52.428314 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4c8a9d63-52a9-4d20-bbaa-f8c090b8c636 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1722 microversion: 2.20 time: 0.215858 Dec 16 14:41:52.429117 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 186/356] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:52 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:52.622607 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d93df437-fadb-4e79-aaab-028956c24451 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:52.623216 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d93df437-fadb-4e79-aaab-028956c24451 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:52.631071 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d93df437-fadb-4e79-aaab-028956c24451 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.631522 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d93df437-fadb-4e79-aaab-028956c24451 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.632300 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d93df437-fadb-4e79-aaab-028956c24451 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.632731 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d93df437-fadb-4e79-aaab-028956c24451 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.781570 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4833f110-fa14-4412-84d6-c5cc5ca7f088 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:52.782173 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4833f110-fa14-4412-84d6-c5cc5ca7f088 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:52.789536 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4833f110-fa14-4412-84d6-c5cc5ca7f088 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.789754 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4833f110-fa14-4412-84d6-c5cc5ca7f088 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.790563 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4833f110-fa14-4412-84d6-c5cc5ca7f088 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:52.790939 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4833f110-fa14-4412-84d6-c5cc5ca7f088 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:52.838701 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d93df437-fadb-4e79-aaab-028956c24451 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:52.847443 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d93df437-fadb-4e79-aaab-028956c24451 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.228484 Dec 16 14:41:52.848319 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 171/357] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:52 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:52.987506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4833f110-fa14-4412-84d6-c5cc5ca7f088 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:52.996087 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4833f110-fa14-4412-84d6-c5cc5ca7f088 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.218237 Dec 16 14:41:52.996639 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 187/358] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:52 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:53.446948 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-65698032-68e0-4aee-ba36-8deab7755b47 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:53.447556 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-65698032-68e0-4aee-ba36-8deab7755b47 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:53.454942 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65698032-68e0-4aee-ba36-8deab7755b47 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:53.455390 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65698032-68e0-4aee-ba36-8deab7755b47 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:53.456148 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65698032-68e0-4aee-ba36-8deab7755b47 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:53.456582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65698032-68e0-4aee-ba36-8deab7755b47 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:53.649594 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-65698032-68e0-4aee-ba36-8deab7755b47 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:53.658993 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-65698032-68e0-4aee-ba36-8deab7755b47 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:53.660480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-65698032-68e0-4aee-ba36-8deab7755b47 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:53.661605 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-65698032-68e0-4aee-ba36-8deab7755b47 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1722 microversion: 2.20 time: 0.218481 Dec 16 14:41:53.662157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 172/359] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:53 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:53.864825 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-6c0819ab-1c18-401e-a489-7a0090f2abda tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:53.864825 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-6c0819ab-1c18-401e-a489-7a0090f2abda tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:53.877811 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6c0819ab-1c18-401e-a489-7a0090f2abda tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:53.878814 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6c0819ab-1c18-401e-a489-7a0090f2abda tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:53.880145 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6c0819ab-1c18-401e-a489-7a0090f2abda tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:53.880820 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6c0819ab-1c18-401e-a489-7a0090f2abda tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.013923 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b9c70c19-7f84-4e9d-9edb-c1c6b0eeb331 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:54.014851 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b9c70c19-7f84-4e9d-9edb-c1c6b0eeb331 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:54.023168 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b9c70c19-7f84-4e9d-9edb-c1c6b0eeb331 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.023708 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b9c70c19-7f84-4e9d-9edb-c1c6b0eeb331 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.024590 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b9c70c19-7f84-4e9d-9edb-c1c6b0eeb331 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.025297 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b9c70c19-7f84-4e9d-9edb-c1c6b0eeb331 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.317452 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6c0819ab-1c18-401e-a489-7a0090f2abda tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:54.325717 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-6c0819ab-1c18-401e-a489-7a0090f2abda tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.465646 Dec 16 14:41:54.326353 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 188/360] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:53 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:54.492415 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b9c70c19-7f84-4e9d-9edb-c1c6b0eeb331 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:54.502180 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b9c70c19-7f84-4e9d-9edb-c1c6b0eeb331 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.492538 Dec 16 14:41:54.503148 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 173/361] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:54 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:54.679500 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8b8640cc-8628-4b98-8012-3390e660ae12 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:54.680097 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8b8640cc-8628-4b98-8012-3390e660ae12 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:54.688389 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b8640cc-8628-4b98-8012-3390e660ae12 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.689099 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b8640cc-8628-4b98-8012-3390e660ae12 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.690190 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b8640cc-8628-4b98-8012-3390e660ae12 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.690733 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b8640cc-8628-4b98-8012-3390e660ae12 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.841966 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-6ef416c1-cf8c-4031-84ca-9058368e1df6 req-14ab89ae-f0c9-40b0-8b58-cbacb869456e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa8e3a5-f077-4adf-bbcf-1f61da473268", "tag": "8e60955b-ae1a-42f6-b082-cf2f17620025"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:54.844428 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:54.844428 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:41:54.857005 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-6ef416c1-cf8c-4031-84ca-9058368e1df6 req-14ab89ae-f0c9-40b0-8b58-cbacb869456e service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.857776 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-6ef416c1-cf8c-4031-84ca-9058368e1df6 req-14ab89ae-f0c9-40b0-8b58-cbacb869456e service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.876524 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-6ef416c1-cf8c-4031-84ca-9058368e1df6 req-14ab89ae-f0c9-40b0-8b58-cbacb869456e service nova] Creating event network-changed:8e60955b-ae1a-42f6-b082-cf2f17620025 for instance eaa8e3a5-f077-4adf-bbcf-1f61da473268 on hv-cinder-82189 Dec 16 14:41:54.882019 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-6ef416c1-cf8c-4031-84ca-9058368e1df6 req-14ab89ae-f0c9-40b0-8b58-cbacb869456e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045494 Dec 16 14:41:54.885936 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 174/362] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:54.903489 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-828cc27f-77dc-4a7b-affd-9a8f9924d0e6 req-b1584fac-316a-40d8-8778-a14c29248c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e7a3c6-dc99-4927-83c2-dd8ba87239b2", "name": "network-vif-unplugged", "status": "completed", "tag": "3086416d-8f44-45e7-a877-073ca8530605"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:54.918637 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:41:54.918637 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:41:54.929166 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-828cc27f-77dc-4a7b-affd-9a8f9924d0e6 req-b1584fac-316a-40d8-8778-a14c29248c8c service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:54.929912 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-828cc27f-77dc-4a7b-affd-9a8f9924d0e6 req-b1584fac-316a-40d8-8778-a14c29248c8c service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:54.962941 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-828cc27f-77dc-4a7b-affd-9a8f9924d0e6 req-b1584fac-316a-40d8-8778-a14c29248c8c service nova] Creating event network-vif-unplugged:3086416d-8f44-45e7-a877-073ca8530605 for instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 on hv-cinder-82189 Dec 16 14:41:54.981794 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-828cc27f-77dc-4a7b-affd-9a8f9924d0e6 req-b1584fac-316a-40d8-8778-a14c29248c8c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082425 Dec 16 14:41:54.991586 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 175/363] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:41:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:55.003101 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-207b7631-d330-46e0-93bc-81395dbd56dd tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a500fe85-4acb-46b8-b2f2-e522675e6e3f"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:55.004548 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-207b7631-d330-46e0-93bc-81395dbd56dd tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:55.012566 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-207b7631-d330-46e0-93bc-81395dbd56dd tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.013059 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-207b7631-d330-46e0-93bc-81395dbd56dd tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.013835 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-207b7631-d330-46e0-93bc-81395dbd56dd tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.014461 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-207b7631-d330-46e0-93bc-81395dbd56dd tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.162801 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8b8640cc-8628-4b98-8012-3390e660ae12 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:55.172628 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8b8640cc-8628-4b98-8012-3390e660ae12 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:55.175012 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8b8640cc-8628-4b98-8012-3390e660ae12 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:55.176213 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8b8640cc-8628-4b98-8012-3390e660ae12 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1722 microversion: 2.20 time: 0.500504 Dec 16 14:41:55.176862 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 189/364] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:54 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1722 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:55.343500 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bd606695-62e3-445a-9615-e15447a6b424 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:55.344111 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bd606695-62e3-445a-9615-e15447a6b424 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:55.352378 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bd606695-62e3-445a-9615-e15447a6b424 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.352855 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bd606695-62e3-445a-9615-e15447a6b424 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.353843 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bd606695-62e3-445a-9615-e15447a6b424 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.354443 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bd606695-62e3-445a-9615-e15447a6b424 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.467087 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-207b7631-d330-46e0-93bc-81395dbd56dd tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "POST /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473859 Dec 16 14:41:55.468134 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 176/365] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:41:54 2021] POST /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:41:55.522742 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-650ba4a0-1999-4658-a5eb-7a4af1f07ffc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:55.529944 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-650ba4a0-1999-4658-a5eb-7a4af1f07ffc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:55.540608 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-650ba4a0-1999-4658-a5eb-7a4af1f07ffc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.541783 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-650ba4a0-1999-4658-a5eb-7a4af1f07ffc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.554953 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-650ba4a0-1999-4658-a5eb-7a4af1f07ffc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:55.556073 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-650ba4a0-1999-4658-a5eb-7a4af1f07ffc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:55.616649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bd606695-62e3-445a-9615-e15447a6b424 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:55.624828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bd606695-62e3-445a-9615-e15447a6b424 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.285641 Dec 16 14:41:55.625575 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 190/366] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:55 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:55.784186 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-650ba4a0-1999-4658-a5eb-7a4af1f07ffc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:55.793050 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-650ba4a0-1999-4658-a5eb-7a4af1f07ffc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.276965 Dec 16 14:41:55.793614 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 177/367] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:55 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:56.196036 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-270a919e-1906-4889-b096-e74568c7b0cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:56.196914 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-270a919e-1906-4889-b096-e74568c7b0cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:56.208173 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-270a919e-1906-4889-b096-e74568c7b0cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:56.208984 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-270a919e-1906-4889-b096-e74568c7b0cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:56.209987 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-270a919e-1906-4889-b096-e74568c7b0cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:56.210655 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-270a919e-1906-4889-b096-e74568c7b0cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:56.407662 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-270a919e-1906-4889-b096-e74568c7b0cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:56.417001 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-270a919e-1906-4889-b096-e74568c7b0cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:56.418497 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-270a919e-1906-4889-b096-e74568c7b0cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:56.419622 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-270a919e-1906-4889-b096-e74568c7b0cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1722 microversion: 2.20 time: 0.228251 Dec 16 14:41:56.420158 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 191/368] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:56 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:56.641845 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f5c8087b-66cc-4d79-8eab-0936e1518d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:56.642589 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f5c8087b-66cc-4d79-8eab-0936e1518d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:56.650410 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f5c8087b-66cc-4d79-8eab-0936e1518d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:56.651061 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f5c8087b-66cc-4d79-8eab-0936e1518d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:56.651823 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f5c8087b-66cc-4d79-8eab-0936e1518d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:56.652496 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f5c8087b-66cc-4d79-8eab-0936e1518d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:56.810874 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7bac41d9-a551-4498-84a8-dfa19119c062 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:56.812525 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7bac41d9-a551-4498-84a8-dfa19119c062 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:56.822886 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7bac41d9-a551-4498-84a8-dfa19119c062 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:56.823709 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7bac41d9-a551-4498-84a8-dfa19119c062 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:56.825241 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7bac41d9-a551-4498-84a8-dfa19119c062 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:56.825886 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7bac41d9-a551-4498-84a8-dfa19119c062 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:56.970002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f5c8087b-66cc-4d79-8eab-0936e1518d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:56.988977 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f5c8087b-66cc-4d79-8eab-0936e1518d36 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.350549 Dec 16 14:41:56.990402 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 178/369] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:56 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:57.067837 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7bac41d9-a551-4498-84a8-dfa19119c062 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:57.076375 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7bac41d9-a551-4498-84a8-dfa19119c062 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1568 microversion: 2.1 time: 0.269960 Dec 16 14:41:57.076958 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 192/370] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:56 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:57.437694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-bec379ed-ba3d-4eaf-ba37-5f84b3e9be16 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:57.438292 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-bec379ed-ba3d-4eaf-ba37-5f84b3e9be16 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:57.446195 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bec379ed-ba3d-4eaf-ba37-5f84b3e9be16 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:57.446639 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bec379ed-ba3d-4eaf-ba37-5f84b3e9be16 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:57.447404 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bec379ed-ba3d-4eaf-ba37-5f84b3e9be16 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:57.447829 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bec379ed-ba3d-4eaf-ba37-5f84b3e9be16 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:57.657147 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-bec379ed-ba3d-4eaf-ba37-5f84b3e9be16 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:57.666428 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-bec379ed-ba3d-4eaf-ba37-5f84b3e9be16 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:57.668586 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-bec379ed-ba3d-4eaf-ba37-5f84b3e9be16 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:57.670022 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-bec379ed-ba3d-4eaf-ba37-5f84b3e9be16 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1722 microversion: 2.20 time: 0.236040 Dec 16 14:41:57.670850 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 179/371] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:57 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:41:58.006493 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e232098e-d685-41c8-86bf-f719d5345129 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:58.007142 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e232098e-d685-41c8-86bf-f719d5345129 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:58.014215 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e232098e-d685-41c8-86bf-f719d5345129 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.014657 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e232098e-d685-41c8-86bf-f719d5345129 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.015416 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e232098e-d685-41c8-86bf-f719d5345129 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.015843 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e232098e-d685-41c8-86bf-f719d5345129 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.094276 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f52d38d2-b233-4be5-93fb-7bfeb75e2164 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:58.095062 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f52d38d2-b233-4be5-93fb-7bfeb75e2164 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:58.102535 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f52d38d2-b233-4be5-93fb-7bfeb75e2164 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.102991 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f52d38d2-b233-4be5-93fb-7bfeb75e2164 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.103768 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f52d38d2-b233-4be5-93fb-7bfeb75e2164 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.104200 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f52d38d2-b233-4be5-93fb-7bfeb75e2164 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.260242 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e232098e-d685-41c8-86bf-f719d5345129 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:58.269357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e232098e-d685-41c8-86bf-f719d5345129 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.267067 Dec 16 14:41:58.269922 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 193/372] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:58 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:58.339860 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f52d38d2-b233-4be5-93fb-7bfeb75e2164 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:58.348550 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f52d38d2-b233-4be5-93fb-7bfeb75e2164 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1548 microversion: 2.1 time: 0.258074 Dec 16 14:41:58.349152 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 180/373] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:58 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1548 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:41:58.365061 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-cf135619-9e9e-425c-850c-401b8f4d5d78 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:58.365548 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-cf135619-9e9e-425c-850c-401b8f4d5d78 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:58.372700 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf135619-9e9e-425c-850c-401b8f4d5d78 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.373178 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf135619-9e9e-425c-850c-401b8f4d5d78 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.373943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf135619-9e9e-425c-850c-401b8f4d5d78 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.374372 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf135619-9e9e-425c-850c-401b8f4d5d78 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.469701 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-212d8272-18ae-4806-a07c-a9c8dd5d2a10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:58.470021 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-212d8272-18ae-4806-a07c-a9c8dd5d2a10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:58.479041 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-212d8272-18ae-4806-a07c-a9c8dd5d2a10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.480518 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-212d8272-18ae-4806-a07c-a9c8dd5d2a10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.481726 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-212d8272-18ae-4806-a07c-a9c8dd5d2a10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.482710 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-212d8272-18ae-4806-a07c-a9c8dd5d2a10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.566446 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-cf135619-9e9e-425c-850c-401b8f4d5d78 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] HTTP exception thrown: Cannot 'detach_volume' instance 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 while it is in vm_state rescued Dec 16 14:41:58.567039 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-cf135619-9e9e-425c-850c-401b8f4d5d78 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Returning 409 to user: Cannot 'detach_volume' instance 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 while it is in vm_state rescued {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:41:58.568107 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-cf135619-9e9e-425c-850c-401b8f4d5d78 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments/787b268a-c69b-4467-a6e5-6c229999469f" status: 409 len: 152 microversion: 2.1 time: 0.207385 Dec 16 14:41:58.568889 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 194/374] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:41:58 2021] DELETE /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments/787b268a-c69b-4467-a6e5-6c229999469f => generated 152 bytes in 209 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 16 14:41:58.577261 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-65334bb3-13e0-4aec-b793-c64b948f7e57 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:58.577854 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-65334bb3-13e0-4aec-b793-c64b948f7e57 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:58.586621 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-65334bb3-13e0-4aec-b793-c64b948f7e57 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.587135 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-65334bb3-13e0-4aec-b793-c64b948f7e57 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.587976 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-65334bb3-13e0-4aec-b793-c64b948f7e57 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.588508 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-65334bb3-13e0-4aec-b793-c64b948f7e57 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.671976 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-212d8272-18ae-4806-a07c-a9c8dd5d2a10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lazy-loading 'services' on Instance uuid 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:41:58.738893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-65334bb3-13e0-4aec-b793-c64b948f7e57 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/action" status: 202 len: 0 microversion: 2.1 time: 0.165038 Dec 16 14:41:58.740473 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 195/375] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:41:58 2021] POST /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:41:58.747513 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-17f2c7ab-0090-4588-8fe8-999b9db18ca6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:58.748318 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-17f2c7ab-0090-4588-8fe8-999b9db18ca6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:58.761675 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-17f2c7ab-0090-4588-8fe8-999b9db18ca6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.761675 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-17f2c7ab-0090-4588-8fe8-999b9db18ca6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.761675 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-17f2c7ab-0090-4588-8fe8-999b9db18ca6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.761675 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-17f2c7ab-0090-4588-8fe8-999b9db18ca6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.851142 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-212d8272-18ae-4806-a07c-a9c8dd5d2a10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2/os-volume_attachments/81d487c8-09b9-4441-b6b0-761c85c98358" status: 202 len: 0 microversion: 2.1 time: 0.384919 Dec 16 14:41:58.852000 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 181/376] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:41:58 2021] DELETE /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2/os-volume_attachments/81d487c8-09b9-4441-b6b0-761c85c98358 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:41:58.874231 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-234a2ce1-a4e0-4add-97b1-ee8bce846c83 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:58.876737 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-234a2ce1-a4e0-4add-97b1-ee8bce846c83 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:58.894513 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-234a2ce1-a4e0-4add-97b1-ee8bce846c83 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.897330 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-234a2ce1-a4e0-4add-97b1-ee8bce846c83 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:58.898702 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-234a2ce1-a4e0-4add-97b1-ee8bce846c83 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:58.903390 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-234a2ce1-a4e0-4add-97b1-ee8bce846c83 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:59.154196 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-17f2c7ab-0090-4588-8fe8-999b9db18ca6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:59.175867 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-17f2c7ab-0090-4588-8fe8-999b9db18ca6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:59.186007 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-17f2c7ab-0090-4588-8fe8-999b9db18ca6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:59.187559 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-17f2c7ab-0090-4588-8fe8-999b9db18ca6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1665 microversion: 2.20 time: 0.445716 Dec 16 14:41:59.188660 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 196/377] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:41:58 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1665 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:41:59.208389 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4972faa1-efaa-4670-b4b6-f7cc8576cb35 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c284bcc1-6b36-48f7-b3bf-1a7341cb1c28"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:59.211591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4972faa1-efaa-4670-b4b6-f7cc8576cb35 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:59.223561 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4972faa1-efaa-4670-b4b6-f7cc8576cb35 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:59.224276 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4972faa1-efaa-4670-b4b6-f7cc8576cb35 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:59.225285 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4972faa1-efaa-4670-b4b6-f7cc8576cb35 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:59.225873 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4972faa1-efaa-4670-b4b6-f7cc8576cb35 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:59.243354 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-234a2ce1-a4e0-4add-97b1-ee8bce846c83 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:59.253257 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-234a2ce1-a4e0-4add-97b1-ee8bce846c83 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1556 microversion: 2.1 time: 0.399630 Dec 16 14:41:59.253975 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 182/378] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:58 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1556 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:59.286388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9d3169b9-a2f1-46b9-a30e-5745229bda88 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:41:59.287114 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9d3169b9-a2f1-46b9-a30e-5745229bda88 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:59.294694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d3169b9-a2f1-46b9-a30e-5745229bda88 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:59.295247 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d3169b9-a2f1-46b9-a30e-5745229bda88 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:59.296096 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d3169b9-a2f1-46b9-a30e-5745229bda88 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:59.296603 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d3169b9-a2f1-46b9-a30e-5745229bda88 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:59.499267 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9d3169b9-a2f1-46b9-a30e-5745229bda88 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:41:59.508189 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9d3169b9-a2f1-46b9-a30e-5745229bda88 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.225549 Dec 16 14:41:59.508771 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 183/379] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:41:59 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:41:59.696193 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4972faa1-efaa-4670-b4b6-f7cc8576cb35 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.493264 Dec 16 14:41:59.697137 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 197/380] 10.222.0.64 () {62 vars in 1363 bytes} [Thu Dec 16 14:41:59 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments => generated 188 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:41:59.909725 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-bd4ca939-eff5-4c36-856b-20aabb96d81b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:41:59.910415 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-bd4ca939-eff5-4c36-856b-20aabb96d81b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:41:59.917823 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bd4ca939-eff5-4c36-856b-20aabb96d81b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:59.918298 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bd4ca939-eff5-4c36-856b-20aabb96d81b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:41:59.919070 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bd4ca939-eff5-4c36-856b-20aabb96d81b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:41:59.919501 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bd4ca939-eff5-4c36-856b-20aabb96d81b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.068723 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-bd4ca939-eff5-4c36-856b-20aabb96d81b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action" status: 202 len: 0 microversion: 2.20 time: 0.164114 Dec 16 14:42:00.069538 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 184/381] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:41:59 2021] POST /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:42:00.077586 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4909f91b-cc3f-4be2-b739-d97e0fbd08e8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:00.078383 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4909f91b-cc3f-4be2-b739-d97e0fbd08e8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:00.089270 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4909f91b-cc3f-4be2-b739-d97e0fbd08e8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:00.090129 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4909f91b-cc3f-4be2-b739-d97e0fbd08e8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.091169 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4909f91b-cc3f-4be2-b739-d97e0fbd08e8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:00.091821 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4909f91b-cc3f-4be2-b739-d97e0fbd08e8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.271653 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-325e63fa-ec05-45b3-93de-0de3da05264c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:00.272259 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-325e63fa-ec05-45b3-93de-0de3da05264c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:00.279439 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-325e63fa-ec05-45b3-93de-0de3da05264c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:00.279883 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-325e63fa-ec05-45b3-93de-0de3da05264c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.280649 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-325e63fa-ec05-45b3-93de-0de3da05264c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:00.281150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-325e63fa-ec05-45b3-93de-0de3da05264c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.312373 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4909f91b-cc3f-4be2-b739-d97e0fbd08e8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:00.323632 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4909f91b-cc3f-4be2-b739-d97e0fbd08e8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:00.325438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4909f91b-cc3f-4be2-b739-d97e0fbd08e8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:00.326663 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4909f91b-cc3f-4be2-b739-d97e0fbd08e8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1751 microversion: 2.20 time: 0.253308 Dec 16 14:42:00.327327 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 198/382] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:00 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1751 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:00.485280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-325e63fa-ec05-45b3-93de-0de3da05264c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:00.494475 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-325e63fa-ec05-45b3-93de-0de3da05264c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1556 microversion: 2.1 time: 0.227192 Dec 16 14:42:00.495370 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 185/383] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:00 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1556 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:00.524810 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-19381cb7-4de7-4315-b454-102b3b139eb5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:00.525599 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-19381cb7-4de7-4315-b454-102b3b139eb5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:00.534200 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-19381cb7-4de7-4315-b454-102b3b139eb5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:00.534778 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-19381cb7-4de7-4315-b454-102b3b139eb5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.535677 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-19381cb7-4de7-4315-b454-102b3b139eb5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:00.536221 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-19381cb7-4de7-4315-b454-102b3b139eb5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:00.790306 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-19381cb7-4de7-4315-b454-102b3b139eb5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:00.798569 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-19381cb7-4de7-4315-b454-102b3b139eb5 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.277419 Dec 16 14:42:00.808015 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 199/384] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:00 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:01.346554 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-caf45794-0cf0-4017-84bf-e02baaefc8bd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:01.347155 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-caf45794-0cf0-4017-84bf-e02baaefc8bd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:01.362516 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-caf45794-0cf0-4017-84bf-e02baaefc8bd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.362960 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-caf45794-0cf0-4017-84bf-e02baaefc8bd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.364086 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-caf45794-0cf0-4017-84bf-e02baaefc8bd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.365122 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-caf45794-0cf0-4017-84bf-e02baaefc8bd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.512397 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f67f6a7e-cd7c-4b59-88b1-d8c9db4a54ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:01.512965 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f67f6a7e-cd7c-4b59-88b1-d8c9db4a54ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:01.520506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f67f6a7e-cd7c-4b59-88b1-d8c9db4a54ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.521004 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f67f6a7e-cd7c-4b59-88b1-d8c9db4a54ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.521781 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f67f6a7e-cd7c-4b59-88b1-d8c9db4a54ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.522280 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f67f6a7e-cd7c-4b59-88b1-d8c9db4a54ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.560461 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-caf45794-0cf0-4017-84bf-e02baaefc8bd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:01.570145 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-caf45794-0cf0-4017-84bf-e02baaefc8bd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:01.572859 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-caf45794-0cf0-4017-84bf-e02baaefc8bd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:01.574952 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-caf45794-0cf0-4017-84bf-e02baaefc8bd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1753 microversion: 2.20 time: 0.232275 Dec 16 14:42:01.575981 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 186/385] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:01 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1753 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:01.720132 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f67f6a7e-cd7c-4b59-88b1-d8c9db4a54ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:01.730422 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f67f6a7e-cd7c-4b59-88b1-d8c9db4a54ae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1556 microversion: 2.1 time: 0.221843 Dec 16 14:42:01.730944 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 200/386] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:01 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1556 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:01.816419 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e98fa8ad-bb16-4f67-a1c7-d59776718e14 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:01.817039 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e98fa8ad-bb16-4f67-a1c7-d59776718e14 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:01.824244 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e98fa8ad-bb16-4f67-a1c7-d59776718e14 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.824693 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e98fa8ad-bb16-4f67-a1c7-d59776718e14 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:01.825488 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e98fa8ad-bb16-4f67-a1c7-d59776718e14 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:01.825920 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e98fa8ad-bb16-4f67-a1c7-d59776718e14 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:02.017191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e98fa8ad-bb16-4f67-a1c7-d59776718e14 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:02.025513 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e98fa8ad-bb16-4f67-a1c7-d59776718e14 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.213479 Dec 16 14:42:02.026081 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 187/387] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:01 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:02.599067 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-58001833-36ac-4a62-bf52-513ee16d6b7d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:02.599912 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-58001833-36ac-4a62-bf52-513ee16d6b7d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:02.607176 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-58001833-36ac-4a62-bf52-513ee16d6b7d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:02.607820 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-58001833-36ac-4a62-bf52-513ee16d6b7d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:02.608625 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-58001833-36ac-4a62-bf52-513ee16d6b7d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:02.609092 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-58001833-36ac-4a62-bf52-513ee16d6b7d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:02.747157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-aab5cc51-8123-43bd-a133-41813a3158ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:02.747764 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-aab5cc51-8123-43bd-a133-41813a3158ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:02.756361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aab5cc51-8123-43bd-a133-41813a3158ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:02.757116 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aab5cc51-8123-43bd-a133-41813a3158ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:02.758059 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aab5cc51-8123-43bd-a133-41813a3158ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:02.758653 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aab5cc51-8123-43bd-a133-41813a3158ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:02.833323 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-58001833-36ac-4a62-bf52-513ee16d6b7d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:02.843140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-58001833-36ac-4a62-bf52-513ee16d6b7d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:02.844956 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-58001833-36ac-4a62-bf52-513ee16d6b7d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:02.846279 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-58001833-36ac-4a62-bf52-513ee16d6b7d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1753 microversion: 2.20 time: 0.250980 Dec 16 14:42:02.856827 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 201/388] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:02 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1753 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:02.985408 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-aab5cc51-8123-43bd-a133-41813a3158ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:02.994915 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-aab5cc51-8123-43bd-a133-41813a3158ee tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1562 microversion: 2.1 time: 0.251301 Dec 16 14:42:02.996201 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 188/389] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:02 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1562 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:03.021059 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-58fe173c-f98f-4aec-841f-6b7b936cb2f8 req-71b0c2d4-65c5-4697-b098-91ab58f8ed48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa8e3a5-f077-4adf-bbcf-1f61da473268", "name": "network-vif-plugged", "status": "completed", "tag": "8e60955b-ae1a-42f6-b082-cf2f17620025"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:03.023888 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:03.023888 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:42:03.035592 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-58fe173c-f98f-4aec-841f-6b7b936cb2f8 req-71b0c2d4-65c5-4697-b098-91ab58f8ed48 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:03.036579 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-58fe173c-f98f-4aec-841f-6b7b936cb2f8 req-71b0c2d4-65c5-4697-b098-91ab58f8ed48 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:03.042818 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-413f98a2-86fb-49d1-9d55-222442a7f623 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:03.043631 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-413f98a2-86fb-49d1-9d55-222442a7f623 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:03.058441 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-413f98a2-86fb-49d1-9d55-222442a7f623 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:03.059206 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-413f98a2-86fb-49d1-9d55-222442a7f623 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:03.060189 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-413f98a2-86fb-49d1-9d55-222442a7f623 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:03.061803 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-413f98a2-86fb-49d1-9d55-222442a7f623 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:03.070764 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-58fe173c-f98f-4aec-841f-6b7b936cb2f8 req-71b0c2d4-65c5-4697-b098-91ab58f8ed48 service nova] Creating event network-vif-plugged:8e60955b-ae1a-42f6-b082-cf2f17620025 for instance eaa8e3a5-f077-4adf-bbcf-1f61da473268 on hv-cinder-82189 Dec 16 14:42:03.076086 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-58fe173c-f98f-4aec-841f-6b7b936cb2f8 req-71b0c2d4-65c5-4697-b098-91ab58f8ed48 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062768 Dec 16 14:42:03.080027 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 202/390] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:03.144302 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7a22f1b7-3742-4b9e-8d6b-b30da40a027a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:03.145069 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7a22f1b7-3742-4b9e-8d6b-b30da40a027a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:03.153561 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7a22f1b7-3742-4b9e-8d6b-b30da40a027a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:03.154101 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7a22f1b7-3742-4b9e-8d6b-b30da40a027a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:03.154997 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7a22f1b7-3742-4b9e-8d6b-b30da40a027a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:03.155501 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7a22f1b7-3742-4b9e-8d6b-b30da40a027a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:03.334957 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-413f98a2-86fb-49d1-9d55-222442a7f623 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:03.344964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-413f98a2-86fb-49d1-9d55-222442a7f623 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.305886 Dec 16 14:42:03.346629 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 189/391] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:03 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:03.367804 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-7a22f1b7-3742-4b9e-8d6b-b30da40a027a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lazy-loading 'services' on Instance uuid 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:42:03.552763 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7a22f1b7-3742-4b9e-8d6b-b30da40a027a tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments/787b268a-c69b-4467-a6e5-6c229999469f" status: 202 len: 0 microversion: 2.1 time: 0.412855 Dec 16 14:42:03.556941 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 203/392] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:42:03 2021] DELETE /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments/787b268a-c69b-4467-a6e5-6c229999469f => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:42:03.563919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-abba8ba6-48dd-4958-a095-2d0851a10ea3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:03.565183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-abba8ba6-48dd-4958-a095-2d0851a10ea3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:03.574943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-abba8ba6-48dd-4958-a095-2d0851a10ea3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:03.575812 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-abba8ba6-48dd-4958-a095-2d0851a10ea3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:03.576749 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-abba8ba6-48dd-4958-a095-2d0851a10ea3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:03.577313 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-abba8ba6-48dd-4958-a095-2d0851a10ea3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:03.648688 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-abba8ba6-48dd-4958-a095-2d0851a10ea3 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089575 Dec 16 14:42:03.649261 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 190/393] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:03 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:03.864286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-06d05c33-c9ce-4dbb-b7e7-92ed673b7948 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:03.864966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-06d05c33-c9ce-4dbb-b7e7-92ed673b7948 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:03.872872 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-06d05c33-c9ce-4dbb-b7e7-92ed673b7948 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:03.873325 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-06d05c33-c9ce-4dbb-b7e7-92ed673b7948 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:03.874226 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-06d05c33-c9ce-4dbb-b7e7-92ed673b7948 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:03.874757 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-06d05c33-c9ce-4dbb-b7e7-92ed673b7948 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.091624 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-06d05c33-c9ce-4dbb-b7e7-92ed673b7948 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:04.102962 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-06d05c33-c9ce-4dbb-b7e7-92ed673b7948 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:04.104635 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-06d05c33-c9ce-4dbb-b7e7-92ed673b7948 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:04.106133 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-06d05c33-c9ce-4dbb-b7e7-92ed673b7948 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1753 microversion: 2.20 time: 0.246122 Dec 16 14:42:04.106760 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 204/394] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:03 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1753 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:04.362945 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0f6ff7ed-0b3d-4330-a4c1-1dad4f5afa4f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:04.363528 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0f6ff7ed-0b3d-4330-a4c1-1dad4f5afa4f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:04.370882 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f6ff7ed-0b3d-4330-a4c1-1dad4f5afa4f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.371330 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f6ff7ed-0b3d-4330-a4c1-1dad4f5afa4f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.372086 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f6ff7ed-0b3d-4330-a4c1-1dad4f5afa4f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.372515 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f6ff7ed-0b3d-4330-a4c1-1dad4f5afa4f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.567451 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-0f6ff7ed-0b3d-4330-a4c1-1dad4f5afa4f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:04.575435 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0f6ff7ed-0b3d-4330-a4c1-1dad4f5afa4f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1313 microversion: 2.1 time: 0.216683 Dec 16 14:42:04.576008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 191/395] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:04 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:04.659800 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3839e302-c549-482c-9976-7f82929557df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:04.660761 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3839e302-c549-482c-9976-7f82929557df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:04.668115 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3839e302-c549-482c-9976-7f82929557df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.668570 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3839e302-c549-482c-9976-7f82929557df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.669406 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3839e302-c549-482c-9976-7f82929557df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.670042 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3839e302-c549-482c-9976-7f82929557df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.708317 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1f3f2be1-db4d-44da-885a-77fc0b46fe27 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a500fe85-4acb-46b8-b2f2-e522675e6e3f"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:04.711062 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1f3f2be1-db4d-44da-885a-77fc0b46fe27 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:04.720886 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1f3f2be1-db4d-44da-885a-77fc0b46fe27 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.721646 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1f3f2be1-db4d-44da-885a-77fc0b46fe27 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.722662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1f3f2be1-db4d-44da-885a-77fc0b46fe27 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.723337 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1f3f2be1-db4d-44da-885a-77fc0b46fe27 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.740007 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3839e302-c549-482c-9976-7f82929557df tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084256 Dec 16 14:42:04.740572 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 205/396] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:04 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:04.882250 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-1f3f2be1-db4d-44da-885a-77fc0b46fe27 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] HTTP exception thrown: Invalid volume: volume a500fe85-4acb-46b8-b2f2-e522675e6e3f is already attached to instances: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787 Dec 16 14:42:04.883031 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1f3f2be1-db4d-44da-885a-77fc0b46fe27 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Returning 400 to user: Invalid volume: volume a500fe85-4acb-46b8-b2f2-e522675e6e3f is already attached to instances: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787 {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:42:04.883823 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1f3f2be1-db4d-44da-885a-77fc0b46fe27 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "POST /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.179559 Dec 16 14:42:04.884428 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 192/397] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:42:04 2021] POST /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 174 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:42:04.990303 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-75cc1c9e-2413-48dd-82a7-65fa8b1442a0 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:04.990792 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-75cc1c9e-2413-48dd-82a7-65fa8b1442a0 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:04.998180 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-75cc1c9e-2413-48dd-82a7-65fa8b1442a0 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.998635 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-75cc1c9e-2413-48dd-82a7-65fa8b1442a0 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:04.999408 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-75cc1c9e-2413-48dd-82a7-65fa8b1442a0 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:04.999850 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-75cc1c9e-2413-48dd-82a7-65fa8b1442a0 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.124295 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e93629ef-8af5-4656-9cf7-2e68c6598401 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:05.125109 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e93629ef-8af5-4656-9cf7-2e68c6598401 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:05.132362 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e93629ef-8af5-4656-9cf7-2e68c6598401 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.132867 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e93629ef-8af5-4656-9cf7-2e68c6598401 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.133844 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e93629ef-8af5-4656-9cf7-2e68c6598401 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.134445 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e93629ef-8af5-4656-9cf7-2e68c6598401 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.170085 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-75cc1c9e-2413-48dd-82a7-65fa8b1442a0 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lazy-loading 'services' on Instance uuid 25a5a09b-6a73-4b0e-accc-7d9eb35ef787 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:42:05.316453 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-75cc1c9e-2413-48dd-82a7-65fa8b1442a0 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "DELETE /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments/a500fe85-4acb-46b8-b2f2-e522675e6e3f" status: 202 len: 0 microversion: 2.1 time: 0.330043 Dec 16 14:42:05.317760 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 206/398] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:42:04 2021] DELETE /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments/a500fe85-4acb-46b8-b2f2-e522675e6e3f => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:42:05.337081 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-229d175e-5fa5-423f-a876-5de3902dd9f6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:05.341661 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-229d175e-5fa5-423f-a876-5de3902dd9f6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:05.358717 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-229d175e-5fa5-423f-a876-5de3902dd9f6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.359166 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-229d175e-5fa5-423f-a876-5de3902dd9f6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.363660 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-229d175e-5fa5-423f-a876-5de3902dd9f6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.364109 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-229d175e-5fa5-423f-a876-5de3902dd9f6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.364248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e93629ef-8af5-4656-9cf7-2e68c6598401 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:05.377608 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e93629ef-8af5-4656-9cf7-2e68c6598401 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:05.382201 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e93629ef-8af5-4656-9cf7-2e68c6598401 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:05.385314 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e93629ef-8af5-4656-9cf7-2e68c6598401 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1753 microversion: 2.20 time: 0.264894 Dec 16 14:42:05.386044 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 193/399] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:05 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1753 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:05.437079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-229d175e-5fa5-423f-a876-5de3902dd9f6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114779 Dec 16 14:42:05.437542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 207/400] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:05 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:05.591411 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-69023d8e-eb21-4529-bd46-b0a8980eadcf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:05.592064 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-69023d8e-eb21-4529-bd46-b0a8980eadcf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:05.599547 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69023d8e-eb21-4529-bd46-b0a8980eadcf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.599997 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69023d8e-eb21-4529-bd46-b0a8980eadcf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.600762 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69023d8e-eb21-4529-bd46-b0a8980eadcf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.601223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69023d8e-eb21-4529-bd46-b0a8980eadcf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.752096 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-37570f73-6daf-4005-83a8-cde7d6d93857 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:05.753065 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-37570f73-6daf-4005-83a8-cde7d6d93857 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:05.760628 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37570f73-6daf-4005-83a8-cde7d6d93857 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.761371 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37570f73-6daf-4005-83a8-cde7d6d93857 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.762324 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37570f73-6daf-4005-83a8-cde7d6d93857 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.762761 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37570f73-6daf-4005-83a8-cde7d6d93857 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.803012 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-69023d8e-eb21-4529-bd46-b0a8980eadcf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:05.811957 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-69023d8e-eb21-4529-bd46-b0a8980eadcf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1498 microversion: 2.1 time: 0.224410 Dec 16 14:42:05.812524 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 194/401] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:05 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:05.819766 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d016fdc2-7975-4a78-90d9-e2cc62525e5b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:05.820531 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d016fdc2-7975-4a78-90d9-e2cc62525e5b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:05.830505 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d016fdc2-7975-4a78-90d9-e2cc62525e5b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.831384 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d016fdc2-7975-4a78-90d9-e2cc62525e5b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.832326 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d016fdc2-7975-4a78-90d9-e2cc62525e5b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:05.832961 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d016fdc2-7975-4a78-90d9-e2cc62525e5b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:05.845978 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-37570f73-6daf-4005-83a8-cde7d6d93857 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098085 Dec 16 14:42:05.847108 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 208/402] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:05 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:05.905215 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d016fdc2-7975-4a78-90d9-e2cc62525e5b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:42:06.019369 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d016fdc2-7975-4a78-90d9-e2cc62525e5b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 204 len: 0 microversion: 2.1 time: 0.203728 Dec 16 14:42:06.020072 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 195/403] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:42:05 2021] DELETE /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:42:06.029045 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0218bd59-8709-4cda-a4e3-338b04ae2a64 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:06.029608 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0218bd59-8709-4cda-a4e3-338b04ae2a64 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:06.036871 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0218bd59-8709-4cda-a4e3-338b04ae2a64 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:06.037313 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0218bd59-8709-4cda-a4e3-338b04ae2a64 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.038074 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0218bd59-8709-4cda-a4e3-338b04ae2a64 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:06.038504 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0218bd59-8709-4cda-a4e3-338b04ae2a64 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.239281 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0218bd59-8709-4cda-a4e3-338b04ae2a64 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:06.249088 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0218bd59-8709-4cda-a4e3-338b04ae2a64 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1513 microversion: 2.1 time: 0.223937 Dec 16 14:42:06.249713 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 209/404] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:06 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:06.404460 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-213620c4-2900-41c7-a7bf-8525d2cffddb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:06.405065 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-213620c4-2900-41c7-a7bf-8525d2cffddb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:06.413289 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-213620c4-2900-41c7-a7bf-8525d2cffddb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:06.413734 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-213620c4-2900-41c7-a7bf-8525d2cffddb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.414518 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-213620c4-2900-41c7-a7bf-8525d2cffddb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:06.414945 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-213620c4-2900-41c7-a7bf-8525d2cffddb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.449083 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-965eee68-1a2e-44a2-a5cd-e8d71ef24b2d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:06.450000 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-965eee68-1a2e-44a2-a5cd-e8d71ef24b2d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:06.457428 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-965eee68-1a2e-44a2-a5cd-e8d71ef24b2d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:06.457861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-965eee68-1a2e-44a2-a5cd-e8d71ef24b2d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.458637 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-965eee68-1a2e-44a2-a5cd-e8d71ef24b2d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:06.459055 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-965eee68-1a2e-44a2-a5cd-e8d71ef24b2d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.530603 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-965eee68-1a2e-44a2-a5cd-e8d71ef24b2d tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085420 Dec 16 14:42:06.531699 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 210/405] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:06 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:06.626659 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-213620c4-2900-41c7-a7bf-8525d2cffddb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:06.636890 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-213620c4-2900-41c7-a7bf-8525d2cffddb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:06.638387 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-213620c4-2900-41c7-a7bf-8525d2cffddb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:06.639692 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-213620c4-2900-41c7-a7bf-8525d2cffddb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1753 microversion: 2.20 time: 0.239740 Dec 16 14:42:06.640244 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 196/406] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:06 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1753 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:06.858959 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8ef2efc8-c0c7-4e73-a03d-3fb4ca796de2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:06.859823 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8ef2efc8-c0c7-4e73-a03d-3fb4ca796de2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:06.867910 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ef2efc8-c0c7-4e73-a03d-3fb4ca796de2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:06.868347 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ef2efc8-c0c7-4e73-a03d-3fb4ca796de2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.869309 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ef2efc8-c0c7-4e73-a03d-3fb4ca796de2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:06.869750 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8ef2efc8-c0c7-4e73-a03d-3fb4ca796de2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:06.939588 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8ef2efc8-c0c7-4e73-a03d-3fb4ca796de2 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084592 Dec 16 14:42:06.940850 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 211/407] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:06 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:07.213454 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-dc57b9ef-2cfd-4ce7-9191-311e7c1231d1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:07.213944 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-dc57b9ef-2cfd-4ce7-9191-311e7c1231d1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:07.221196 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dc57b9ef-2cfd-4ce7-9191-311e7c1231d1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.221785 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dc57b9ef-2cfd-4ce7-9191-311e7c1231d1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.222651 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dc57b9ef-2cfd-4ce7-9191-311e7c1231d1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.223086 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dc57b9ef-2cfd-4ce7-9191-311e7c1231d1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.266293 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a2bbda0a-559a-46fc-a838-8e578dcc1c26 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:07.266899 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a2bbda0a-559a-46fc-a838-8e578dcc1c26 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:07.275015 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2bbda0a-559a-46fc-a838-8e578dcc1c26 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.275467 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2bbda0a-559a-46fc-a838-8e578dcc1c26 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.276330 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2bbda0a-559a-46fc-a838-8e578dcc1c26 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.276759 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2bbda0a-559a-46fc-a838-8e578dcc1c26 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.284187 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-dc57b9ef-2cfd-4ce7-9191-311e7c1231d1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:42:07.399094 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-dc57b9ef-2cfd-4ce7-9191-311e7c1231d1 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "DELETE /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 204 len: 0 microversion: 2.1 time: 0.188699 Dec 16 14:42:07.400126 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 197/408] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:42:07 2021] DELETE /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:42:07.409390 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3aa5b4b3-f390-4dcf-9959-3e384ccf827a tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:07.410251 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3aa5b4b3-f390-4dcf-9959-3e384ccf827a tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:07.418045 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3aa5b4b3-f390-4dcf-9959-3e384ccf827a tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.418654 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3aa5b4b3-f390-4dcf-9959-3e384ccf827a tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.419460 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3aa5b4b3-f390-4dcf-9959-3e384ccf827a tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.420095 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3aa5b4b3-f390-4dcf-9959-3e384ccf827a tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.484972 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a2bbda0a-559a-46fc-a838-8e578dcc1c26 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:07.494649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a2bbda0a-559a-46fc-a838-8e578dcc1c26 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1513 microversion: 2.1 time: 0.232014 Dec 16 14:42:07.495311 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 212/409] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:07 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:07.543822 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-79d9d66d-45d9-47b6-a966-f6c0903d5385 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:07.545064 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-79d9d66d-45d9-47b6-a966-f6c0903d5385 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:07.553075 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-79d9d66d-45d9-47b6-a966-f6c0903d5385 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.553517 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-79d9d66d-45d9-47b6-a966-f6c0903d5385 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.554300 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-79d9d66d-45d9-47b6-a966-f6c0903d5385 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.554917 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-79d9d66d-45d9-47b6-a966-f6c0903d5385 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.628910 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-3aa5b4b3-f390-4dcf-9959-3e384ccf827a tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:07.629518 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-79d9d66d-45d9-47b6-a966-f6c0903d5385 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090299 Dec 16 14:42:07.630565 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 213/410] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:07 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:07.638225 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3aa5b4b3-f390-4dcf-9959-3e384ccf827a tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.233156 Dec 16 14:42:07.639028 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 198/411] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:07 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:07.658465 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a2487628-86d1-4727-9386-e4c0c7f9e05f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:07.659626 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a2487628-86d1-4727-9386-e4c0c7f9e05f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:07.666985 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2487628-86d1-4727-9386-e4c0c7f9e05f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.667439 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2487628-86d1-4727-9386-e4c0c7f9e05f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.668270 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2487628-86d1-4727-9386-e4c0c7f9e05f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.668651 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2487628-86d1-4727-9386-e4c0c7f9e05f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.869328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a2487628-86d1-4727-9386-e4c0c7f9e05f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:07.879301 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a2487628-86d1-4727-9386-e4c0c7f9e05f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:07.880996 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a2487628-86d1-4727-9386-e4c0c7f9e05f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:07.882260 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a2487628-86d1-4727-9386-e4c0c7f9e05f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.227612 Dec 16 14:42:07.883117 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 214/412] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:07 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:07.950896 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-00b4bac3-72df-4db0-9b72-c7051b680bec tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:07.951885 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-00b4bac3-72df-4db0-9b72-c7051b680bec tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:07.959294 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-00b4bac3-72df-4db0-9b72-c7051b680bec tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.959621 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-00b4bac3-72df-4db0-9b72-c7051b680bec tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:07.960395 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-00b4bac3-72df-4db0-9b72-c7051b680bec tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:07.960860 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-00b4bac3-72df-4db0-9b72-c7051b680bec tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.026633 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-00b4bac3-72df-4db0-9b72-c7051b680bec tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079532 Dec 16 14:42:08.027217 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 199/413] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:07 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:08.511791 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-96448084-c15d-4880-9dca-f195d8c24958 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:08.512343 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-96448084-c15d-4880-9dca-f195d8c24958 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:08.520823 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-96448084-c15d-4880-9dca-f195d8c24958 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:08.521278 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-96448084-c15d-4880-9dca-f195d8c24958 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.522060 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-96448084-c15d-4880-9dca-f195d8c24958 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:08.522497 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-96448084-c15d-4880-9dca-f195d8c24958 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.640869 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-76338673-9339-40ab-9ee7-18121eb8d889 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:08.641892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-76338673-9339-40ab-9ee7-18121eb8d889 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:08.651650 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76338673-9339-40ab-9ee7-18121eb8d889 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:08.652081 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76338673-9339-40ab-9ee7-18121eb8d889 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.652876 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76338673-9339-40ab-9ee7-18121eb8d889 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:08.653311 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-76338673-9339-40ab-9ee7-18121eb8d889 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.717250 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-76338673-9339-40ab-9ee7-18121eb8d889 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080187 Dec 16 14:42:08.717812 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 200/414] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:08 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:08.724648 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-de930fc3-5da0-4ea9-a28b-9cb87a58df17 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:08.725062 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-96448084-c15d-4880-9dca-f195d8c24958 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:08.725275 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-de930fc3-5da0-4ea9-a28b-9cb87a58df17 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:08.734150 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-96448084-c15d-4880-9dca-f195d8c24958 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1513 microversion: 2.1 time: 0.226155 Dec 16 14:42:08.734889 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 215/415] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:08 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:08.735777 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de930fc3-5da0-4ea9-a28b-9cb87a58df17 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:08.736285 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de930fc3-5da0-4ea9-a28b-9cb87a58df17 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.737163 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de930fc3-5da0-4ea9-a28b-9cb87a58df17 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:08.737594 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de930fc3-5da0-4ea9-a28b-9cb87a58df17 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.900220 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-189ea56f-aa1a-47d4-a7b2-249a20600bde tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:08.900845 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-189ea56f-aa1a-47d4-a7b2-249a20600bde tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:08.908144 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-189ea56f-aa1a-47d4-a7b2-249a20600bde tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:08.908594 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-189ea56f-aa1a-47d4-a7b2-249a20600bde tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.909434 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-189ea56f-aa1a-47d4-a7b2-249a20600bde tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:08.909865 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-189ea56f-aa1a-47d4-a7b2-249a20600bde tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:08.932042 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-de930fc3-5da0-4ea9-a28b-9cb87a58df17 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:08.940949 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-de930fc3-5da0-4ea9-a28b-9cb87a58df17 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.221553 Dec 16 14:42:08.941515 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 201/416] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:08 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:09.037784 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-902d7c05-dc94-4ca9-a87d-0fe27e6c4cc6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:09.038657 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-902d7c05-dc94-4ca9-a87d-0fe27e6c4cc6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:09.047509 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-902d7c05-dc94-4ca9-a87d-0fe27e6c4cc6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.047965 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-902d7c05-dc94-4ca9-a87d-0fe27e6c4cc6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.048755 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-902d7c05-dc94-4ca9-a87d-0fe27e6c4cc6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.049225 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-902d7c05-dc94-4ca9-a87d-0fe27e6c4cc6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.120246 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-902d7c05-dc94-4ca9-a87d-0fe27e6c4cc6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086293 Dec 16 14:42:09.121694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 202/417] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:09 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:42:09.198606 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-189ea56f-aa1a-47d4-a7b2-249a20600bde tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:09.208140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-189ea56f-aa1a-47d4-a7b2-249a20600bde tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:09.210091 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-189ea56f-aa1a-47d4-a7b2-249a20600bde tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:09.211325 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-189ea56f-aa1a-47d4-a7b2-249a20600bde tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.314670 Dec 16 14:42:09.212203 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 216/418] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:08 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:09.728741 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-96df238c-ed4c-4d7a-a539-bb61a3885c9b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:09.729670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-96df238c-ed4c-4d7a-a539-bb61a3885c9b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:09.737040 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-96df238c-ed4c-4d7a-a539-bb61a3885c9b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.737677 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-96df238c-ed4c-4d7a-a539-bb61a3885c9b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.738258 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-96df238c-ed4c-4d7a-a539-bb61a3885c9b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.738683 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-96df238c-ed4c-4d7a-a539-bb61a3885c9b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.752597 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-62a446ab-babf-4222-bf64-fb4e04865b5c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:09.753955 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-62a446ab-babf-4222-bf64-fb4e04865b5c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:09.761539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-62a446ab-babf-4222-bf64-fb4e04865b5c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.762073 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-62a446ab-babf-4222-bf64-fb4e04865b5c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.762939 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-62a446ab-babf-4222-bf64-fb4e04865b5c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.763438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-62a446ab-babf-4222-bf64-fb4e04865b5c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.807428 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-96df238c-ed4c-4d7a-a539-bb61a3885c9b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081678 Dec 16 14:42:09.811894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 203/419] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:09 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:09.958866 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d38c10a2-2977-4dec-aada-c19ee17405eb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:09.959548 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d38c10a2-2977-4dec-aada-c19ee17405eb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:09.967723 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d38c10a2-2977-4dec-aada-c19ee17405eb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.968456 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d38c10a2-2977-4dec-aada-c19ee17405eb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:09.969448 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d38c10a2-2977-4dec-aada-c19ee17405eb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:09.970063 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d38c10a2-2977-4dec-aada-c19ee17405eb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:10.159435 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-62a446ab-babf-4222-bf64-fb4e04865b5c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:10.171352 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-62a446ab-babf-4222-bf64-fb4e04865b5c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1513 microversion: 2.1 time: 0.423549 Dec 16 14:42:10.172491 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 217/420] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:09 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1513 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:10.230320 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3773124b-f1f3-4b82-9d53-bf6ecb5a1ebd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:10.230930 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3773124b-f1f3-4b82-9d53-bf6ecb5a1ebd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:10.238866 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3773124b-f1f3-4b82-9d53-bf6ecb5a1ebd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:10.239340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3773124b-f1f3-4b82-9d53-bf6ecb5a1ebd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:10.240125 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3773124b-f1f3-4b82-9d53-bf6ecb5a1ebd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:10.240816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3773124b-f1f3-4b82-9d53-bf6ecb5a1ebd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:10.248892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d38c10a2-2977-4dec-aada-c19ee17405eb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:10.259090 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d38c10a2-2977-4dec-aada-c19ee17405eb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.304885 Dec 16 14:42:10.259787 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 204/421] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:09 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:10.387698 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-e6ab8443-5f7a-4fef-b91f-cc2964fe1a34 req-6b287fc1-20bb-42bf-ba5f-0c6f17a9529c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f59e7d9-2df3-4788-a597-ff7dd7c2acc2", "name": "network-vif-deleted", "tag": "638cd2b4-5782-43ae-9e3b-408206bfa8d9"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:10.389679 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:10.389679 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:42:10.398532 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-e6ab8443-5f7a-4fef-b91f-cc2964fe1a34 req-6b287fc1-20bb-42bf-ba5f-0c6f17a9529c service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:10.398978 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-e6ab8443-5f7a-4fef-b91f-cc2964fe1a34 req-6b287fc1-20bb-42bf-ba5f-0c6f17a9529c service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:10.414980 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-e6ab8443-5f7a-4fef-b91f-cc2964fe1a34 req-6b287fc1-20bb-42bf-ba5f-0c6f17a9529c service nova] Creating event network-vif-deleted:638cd2b4-5782-43ae-9e3b-408206bfa8d9 for instance 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 on hv-cinder-82189 Dec 16 14:42:10.419707 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-e6ab8443-5f7a-4fef-b91f-cc2964fe1a34 req-6b287fc1-20bb-42bf-ba5f-0c6f17a9529c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036185 Dec 16 14:42:10.420304 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 205/422] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:10.467849 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3773124b-f1f3-4b82-9d53-bf6ecb5a1ebd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:10.482184 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3773124b-f1f3-4b82-9d53-bf6ecb5a1ebd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:10.483785 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3773124b-f1f3-4b82-9d53-bf6ecb5a1ebd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:10.485117 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3773124b-f1f3-4b82-9d53-bf6ecb5a1ebd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.258738 Dec 16 14:42:10.486096 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 218/423] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:10 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:10.820524 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-34a574ec-f80f-4a65-a576-f9972e8a38f5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:10.821759 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-34a574ec-f80f-4a65-a576-f9972e8a38f5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:10.830430 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-34a574ec-f80f-4a65-a576-f9972e8a38f5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:10.830982 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-34a574ec-f80f-4a65-a576-f9972e8a38f5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:10.831943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-34a574ec-f80f-4a65-a576-f9972e8a38f5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:10.832454 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-34a574ec-f80f-4a65-a576-f9972e8a38f5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:10.927448 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-34a574ec-f80f-4a65-a576-f9972e8a38f5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112046 Dec 16 14:42:10.928008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 206/424] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:10 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:11.189057 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-07d767fb-9aa1-4278-9324-8c8eec41992a tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:11.189671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-07d767fb-9aa1-4278-9324-8c8eec41992a tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:11.196993 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-07d767fb-9aa1-4278-9324-8c8eec41992a tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.197446 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-07d767fb-9aa1-4278-9324-8c8eec41992a tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.198218 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-07d767fb-9aa1-4278-9324-8c8eec41992a tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.198646 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-07d767fb-9aa1-4278-9324-8c8eec41992a tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.276674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e65ae36d-802b-45e1-bb41-f38507f973f4 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:11.277487 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e65ae36d-802b-45e1-bb41-f38507f973f4 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:11.286661 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e65ae36d-802b-45e1-bb41-f38507f973f4 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.287237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e65ae36d-802b-45e1-bb41-f38507f973f4 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.288178 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e65ae36d-802b-45e1-bb41-f38507f973f4 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.288722 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e65ae36d-802b-45e1-bb41-f38507f973f4 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.330039 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-07d767fb-9aa1-4278-9324-8c8eec41992a tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:11.339411 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-07d767fb-9aa1-4278-9324-8c8eec41992a tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.153966 Dec 16 14:42:11.339995 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 219/425] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:11 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:11.499903 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e65ae36d-802b-45e1-bb41-f38507f973f4 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:11.503875 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-60d8bdca-38ea-42e8-bdb4-2e57f2e01336 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:11.504480 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-60d8bdca-38ea-42e8-bdb4-2e57f2e01336 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:11.509041 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e65ae36d-802b-45e1-bb41-f38507f973f4 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.236070 Dec 16 14:42:11.509717 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 207/426] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:11 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:11.511585 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-60d8bdca-38ea-42e8-bdb4-2e57f2e01336 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.512043 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-60d8bdca-38ea-42e8-bdb4-2e57f2e01336 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.512911 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-60d8bdca-38ea-42e8-bdb4-2e57f2e01336 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.513296 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-60d8bdca-38ea-42e8-bdb4-2e57f2e01336 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.719300 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-60d8bdca-38ea-42e8-bdb4-2e57f2e01336 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:11.728714 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-60d8bdca-38ea-42e8-bdb4-2e57f2e01336 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:11.730268 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-60d8bdca-38ea-42e8-bdb4-2e57f2e01336 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:11.731390 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-60d8bdca-38ea-42e8-bdb4-2e57f2e01336 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.231784 Dec 16 14:42:11.731948 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 220/427] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:11 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:11.751304 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-44a39d60-4a0c-48dc-ace7-9f7b5060a69b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:11.751796 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-44a39d60-4a0c-48dc-ace7-9f7b5060a69b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:11.759451 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-44a39d60-4a0c-48dc-ace7-9f7b5060a69b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.759895 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-44a39d60-4a0c-48dc-ace7-9f7b5060a69b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.760648 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-44a39d60-4a0c-48dc-ace7-9f7b5060a69b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.761096 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-44a39d60-4a0c-48dc-ace7-9f7b5060a69b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.828522 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-44a39d60-4a0c-48dc-ace7-9f7b5060a69b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:42:11.938899 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-eddc3954-4da3-4c7d-a732-ae45d133ba31 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:11.940712 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-eddc3954-4da3-4c7d-a732-ae45d133ba31 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:11.949159 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eddc3954-4da3-4c7d-a732-ae45d133ba31 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.949836 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eddc3954-4da3-4c7d-a732-ae45d133ba31 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.950764 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eddc3954-4da3-4c7d-a732-ae45d133ba31 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.951332 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eddc3954-4da3-4c7d-a732-ae45d133ba31 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.954949 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-44a39d60-4a0c-48dc-ace7-9f7b5060a69b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "DELETE /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 204 len: 0 microversion: 2.1 time: 0.206888 Dec 16 14:42:11.955819 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 208/428] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:42:11 2021] DELETE /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:42:11.969315 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-54d1ea0b-51a8-41d9-b732-b7f79d31298e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:11.969935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-54d1ea0b-51a8-41d9-b732-b7f79d31298e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:11.979003 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-54d1ea0b-51a8-41d9-b732-b7f79d31298e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.979461 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-54d1ea0b-51a8-41d9-b732-b7f79d31298e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:11.980244 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-54d1ea0b-51a8-41d9-b732-b7f79d31298e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:11.980758 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-54d1ea0b-51a8-41d9-b732-b7f79d31298e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:12.031068 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-eddc3954-4da3-4c7d-a732-ae45d133ba31 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096190 Dec 16 14:42:12.031875 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 221/429] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:11 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:12.202105 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-54d1ea0b-51a8-41d9-b732-b7f79d31298e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:12.210313 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-54d1ea0b-51a8-41d9-b732-b7f79d31298e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.246055 Dec 16 14:42:12.210892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 209/430] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:11 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:12.359980 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-59b9c4be-0268-44c7-9576-99fb051ff0ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:12.360524 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-59b9c4be-0268-44c7-9576-99fb051ff0ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:12.368484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-59b9c4be-0268-44c7-9576-99fb051ff0ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:12.369028 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-59b9c4be-0268-44c7-9576-99fb051ff0ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:12.369883 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-59b9c4be-0268-44c7-9576-99fb051ff0ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:12.370291 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-59b9c4be-0268-44c7-9576-99fb051ff0ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:12.481138 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-59b9c4be-0268-44c7-9576-99fb051ff0ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:12.489813 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-59b9c4be-0268-44c7-9576-99fb051ff0ed tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.134783 Dec 16 14:42:12.490368 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 222/431] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:12 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:12.529150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-adbfcafa-9949-40f0-a7af-3c15692933d9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:12.530081 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-adbfcafa-9949-40f0-a7af-3c15692933d9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:12.539344 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-adbfcafa-9949-40f0-a7af-3c15692933d9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:12.539924 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-adbfcafa-9949-40f0-a7af-3c15692933d9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:12.540818 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-adbfcafa-9949-40f0-a7af-3c15692933d9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:12.541365 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-adbfcafa-9949-40f0-a7af-3c15692933d9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:12.746361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-adbfcafa-9949-40f0-a7af-3c15692933d9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:12.749546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f0c60745-11b7-4638-80b7-ac14ee395d00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:12.750086 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f0c60745-11b7-4638-80b7-ac14ee395d00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:12.754898 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-adbfcafa-9949-40f0-a7af-3c15692933d9 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.231594 Dec 16 14:42:12.755493 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 210/432] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:12 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:12.757278 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f0c60745-11b7-4638-80b7-ac14ee395d00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:12.757729 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f0c60745-11b7-4638-80b7-ac14ee395d00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:12.758518 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f0c60745-11b7-4638-80b7-ac14ee395d00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:12.758953 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f0c60745-11b7-4638-80b7-ac14ee395d00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:12.967383 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f0c60745-11b7-4638-80b7-ac14ee395d00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:12.977637 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f0c60745-11b7-4638-80b7-ac14ee395d00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:12.979160 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f0c60745-11b7-4638-80b7-ac14ee395d00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:12.980306 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f0c60745-11b7-4638-80b7-ac14ee395d00 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.234499 Dec 16 14:42:12.981306 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 223/433] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:12 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:13.042631 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-bc96d3ac-fd94-4c98-9b18-30961cd84c6b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:13.043663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-bc96d3ac-fd94-4c98-9b18-30961cd84c6b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:13.051541 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bc96d3ac-fd94-4c98-9b18-30961cd84c6b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:13.051988 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bc96d3ac-fd94-4c98-9b18-30961cd84c6b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.052754 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bc96d3ac-fd94-4c98-9b18-30961cd84c6b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:13.053229 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-bc96d3ac-fd94-4c98-9b18-30961cd84c6b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.120204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-bc96d3ac-fd94-4c98-9b18-30961cd84c6b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081451 Dec 16 14:42:13.120776 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 211/434] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:13 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:13.228082 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b0484e03-122c-480f-8c8b-ef9860df7a16 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:13.228594 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b0484e03-122c-480f-8c8b-ef9860df7a16 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:13.235926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b0484e03-122c-480f-8c8b-ef9860df7a16 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:13.236356 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b0484e03-122c-480f-8c8b-ef9860df7a16 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.237821 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b0484e03-122c-480f-8c8b-ef9860df7a16 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:13.238249 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b0484e03-122c-480f-8c8b-ef9860df7a16 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.444420 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b0484e03-122c-480f-8c8b-ef9860df7a16 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:13.454368 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b0484e03-122c-480f-8c8b-ef9860df7a16 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.230203 Dec 16 14:42:13.458452 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 224/435] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:13 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:13.506459 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-03efcd27-b983-4e17-8951-fa386b3359d0 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:13.506998 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-03efcd27-b983-4e17-8951-fa386b3359d0 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:13.514365 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-03efcd27-b983-4e17-8951-fa386b3359d0 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:13.514803 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-03efcd27-b983-4e17-8951-fa386b3359d0 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.515582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-03efcd27-b983-4e17-8951-fa386b3359d0 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:13.516007 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-03efcd27-b983-4e17-8951-fa386b3359d0 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.635677 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-03efcd27-b983-4e17-8951-fa386b3359d0 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:13.645434 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-03efcd27-b983-4e17-8951-fa386b3359d0 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.142660 Dec 16 14:42:13.646008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 212/436] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:13 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:13.772918 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-65eb65e9-aaf8-474b-a3b0-ba1640a93176 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:13.773441 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-65eb65e9-aaf8-474b-a3b0-ba1640a93176 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:13.780718 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-65eb65e9-aaf8-474b-a3b0-ba1640a93176 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:13.781300 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-65eb65e9-aaf8-474b-a3b0-ba1640a93176 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.782115 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-65eb65e9-aaf8-474b-a3b0-ba1640a93176 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:13.782753 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-65eb65e9-aaf8-474b-a3b0-ba1640a93176 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:13.995752 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-65eb65e9-aaf8-474b-a3b0-ba1640a93176 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:13.999729 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-773bf082-3fa5-4c28-805e-e2d0f11b90ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:14.000340 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-773bf082-3fa5-4c28-805e-e2d0f11b90ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:14.005547 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-65eb65e9-aaf8-474b-a3b0-ba1640a93176 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.236341 Dec 16 14:42:14.006312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 225/437] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:13 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:14.010478 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-773bf082-3fa5-4c28-805e-e2d0f11b90ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.010924 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-773bf082-3fa5-4c28-805e-e2d0f11b90ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:14.011695 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-773bf082-3fa5-4c28-805e-e2d0f11b90ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.012120 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-773bf082-3fa5-4c28-805e-e2d0f11b90ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:14.132079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-05cf3f02-6a49-456a-bdd0-9afbb4cfc9ab tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:14.133270 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-05cf3f02-6a49-456a-bdd0-9afbb4cfc9ab tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:14.144181 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-05cf3f02-6a49-456a-bdd0-9afbb4cfc9ab tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.150142 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-05cf3f02-6a49-456a-bdd0-9afbb4cfc9ab tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:14.160424 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-05cf3f02-6a49-456a-bdd0-9afbb4cfc9ab tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.160905 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-05cf3f02-6a49-456a-bdd0-9afbb4cfc9ab tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:14.235126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-05cf3f02-6a49-456a-bdd0-9afbb4cfc9ab tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107182 Dec 16 14:42:14.237079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 226/438] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:14 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:14.250494 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-773bf082-3fa5-4c28-805e-e2d0f11b90ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:14.263491 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-773bf082-3fa5-4c28-805e-e2d0f11b90ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:14.265697 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-773bf082-3fa5-4c28-805e-e2d0f11b90ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:14.267961 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-773bf082-3fa5-4c28-805e-e2d0f11b90ac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.272143 Dec 16 14:42:14.269101 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 213/439] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:13 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:14.472081 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5e3c36ba-134e-4759-9e96-680427fa50e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:14.472676 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5e3c36ba-134e-4759-9e96-680427fa50e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:14.480411 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5e3c36ba-134e-4759-9e96-680427fa50e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.480905 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5e3c36ba-134e-4759-9e96-680427fa50e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:14.481723 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5e3c36ba-134e-4759-9e96-680427fa50e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.482157 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5e3c36ba-134e-4759-9e96-680427fa50e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:14.663305 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-000a5d44-c2ac-4ef1-9ed9-ed88e8b98852 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:14.664189 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-000a5d44-c2ac-4ef1-9ed9-ed88e8b98852 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:14.672143 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-000a5d44-c2ac-4ef1-9ed9-ed88e8b98852 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.672597 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-000a5d44-c2ac-4ef1-9ed9-ed88e8b98852 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:14.673520 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-000a5d44-c2ac-4ef1-9ed9-ed88e8b98852 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:14.673956 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-000a5d44-c2ac-4ef1-9ed9-ed88e8b98852 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:14.688735 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5e3c36ba-134e-4759-9e96-680427fa50e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:14.697060 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5e3c36ba-134e-4759-9e96-680427fa50e0 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.229064 Dec 16 14:42:14.697708 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 227/440] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:14 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:14.787864 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-000a5d44-c2ac-4ef1-9ed9-ed88e8b98852 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:14.796479 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-000a5d44-c2ac-4ef1-9ed9-ed88e8b98852 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.136821 Dec 16 14:42:14.797210 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 214/441] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:14 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:15.023416 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-cc365bb2-217a-4b5c-8a35-0335d2ee622b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:15.024019 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-cc365bb2-217a-4b5c-8a35-0335d2ee622b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:15.032450 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cc365bb2-217a-4b5c-8a35-0335d2ee622b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.033243 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cc365bb2-217a-4b5c-8a35-0335d2ee622b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.034828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cc365bb2-217a-4b5c-8a35-0335d2ee622b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.035631 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cc365bb2-217a-4b5c-8a35-0335d2ee622b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.244242 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-cc365bb2-217a-4b5c-8a35-0335d2ee622b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:15.247353 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-56af0eeb-e02e-49f2-bc85-b01f26d82f83 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:15.248313 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-56af0eeb-e02e-49f2-bc85-b01f26d82f83 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:15.253632 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-cc365bb2-217a-4b5c-8a35-0335d2ee622b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.233999 Dec 16 14:42:15.254240 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 228/442] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:15 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:15.256050 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-56af0eeb-e02e-49f2-bc85-b01f26d82f83 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.256534 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-56af0eeb-e02e-49f2-bc85-b01f26d82f83 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.257283 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-56af0eeb-e02e-49f2-bc85-b01f26d82f83 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.257712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-56af0eeb-e02e-49f2-bc85-b01f26d82f83 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.291150 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-73b2e7e0-707e-4dc9-864d-db623530f4f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:15.291770 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-73b2e7e0-707e-4dc9-864d-db623530f4f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:15.299424 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-73b2e7e0-707e-4dc9-864d-db623530f4f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.299965 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-73b2e7e0-707e-4dc9-864d-db623530f4f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.300895 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-73b2e7e0-707e-4dc9-864d-db623530f4f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.301409 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-73b2e7e0-707e-4dc9-864d-db623530f4f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.322782 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-56af0eeb-e02e-49f2-bc85-b01f26d82f83 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079060 Dec 16 14:42:15.323347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 215/443] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:15 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:15.560872 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-73b2e7e0-707e-4dc9-864d-db623530f4f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:15.570939 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-73b2e7e0-707e-4dc9-864d-db623530f4f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:15.572451 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-73b2e7e0-707e-4dc9-864d-db623530f4f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:15.573605 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-73b2e7e0-707e-4dc9-864d-db623530f4f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.286219 Dec 16 14:42:15.574151 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 229/444] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:15 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:15.713644 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-efffa6dc-a24d-42ca-af10-0aea4ac5751f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:15.714243 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-efffa6dc-a24d-42ca-af10-0aea4ac5751f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:15.721571 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-efffa6dc-a24d-42ca-af10-0aea4ac5751f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.722016 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-efffa6dc-a24d-42ca-af10-0aea4ac5751f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.722777 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-efffa6dc-a24d-42ca-af10-0aea4ac5751f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.723209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-efffa6dc-a24d-42ca-af10-0aea4ac5751f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.815246 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4732f5eb-22b1-468f-9e78-adf683faa8ad tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:15.815979 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4732f5eb-22b1-468f-9e78-adf683faa8ad tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:15.830136 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4732f5eb-22b1-468f-9e78-adf683faa8ad tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.830805 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4732f5eb-22b1-468f-9e78-adf683faa8ad tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.831449 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4732f5eb-22b1-468f-9e78-adf683faa8ad tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:15.831890 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4732f5eb-22b1-468f-9e78-adf683faa8ad tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:15.973270 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4732f5eb-22b1-468f-9e78-adf683faa8ad tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:15.982079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4732f5eb-22b1-468f-9e78-adf683faa8ad tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.171440 Dec 16 14:42:15.982652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 230/445] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:15 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:16.043964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-efffa6dc-a24d-42ca-af10-0aea4ac5751f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:16.052458 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-efffa6dc-a24d-42ca-af10-0aea4ac5751f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.342431 Dec 16 14:42:16.053133 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 216/446] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:15 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:16.271355 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5ed4b56a-0057-435c-af87-78d0e68fc51f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:16.271954 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5ed4b56a-0057-435c-af87-78d0e68fc51f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:16.279476 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ed4b56a-0057-435c-af87-78d0e68fc51f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:16.280122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ed4b56a-0057-435c-af87-78d0e68fc51f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:16.281170 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ed4b56a-0057-435c-af87-78d0e68fc51f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:16.281667 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ed4b56a-0057-435c-af87-78d0e68fc51f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:16.334365 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a5fb7103-9da5-46e1-8b39-4aa7c2a50380 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:16.335287 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a5fb7103-9da5-46e1-8b39-4aa7c2a50380 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:16.342581 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a5fb7103-9da5-46e1-8b39-4aa7c2a50380 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:16.343033 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a5fb7103-9da5-46e1-8b39-4aa7c2a50380 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:16.343801 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a5fb7103-9da5-46e1-8b39-4aa7c2a50380 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:16.344235 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a5fb7103-9da5-46e1-8b39-4aa7c2a50380 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:16.411511 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a5fb7103-9da5-46e1-8b39-4aa7c2a50380 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080817 Dec 16 14:42:16.412442 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 217/447] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:16 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:16.497103 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5ed4b56a-0057-435c-af87-78d0e68fc51f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:16.506105 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5ed4b56a-0057-435c-af87-78d0e68fc51f tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.239413 Dec 16 14:42:16.506658 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 231/448] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:16 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:16.592088 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-120cc0c7-62ab-41de-8fb3-51730fdd2622 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:16.592595 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-120cc0c7-62ab-41de-8fb3-51730fdd2622 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:16.599788 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-120cc0c7-62ab-41de-8fb3-51730fdd2622 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:16.600228 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-120cc0c7-62ab-41de-8fb3-51730fdd2622 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:16.601010 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-120cc0c7-62ab-41de-8fb3-51730fdd2622 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:16.601433 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-120cc0c7-62ab-41de-8fb3-51730fdd2622 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:16.810667 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-120cc0c7-62ab-41de-8fb3-51730fdd2622 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:16.823968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-120cc0c7-62ab-41de-8fb3-51730fdd2622 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:16.825668 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-120cc0c7-62ab-41de-8fb3-51730fdd2622 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:16.826799 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-120cc0c7-62ab-41de-8fb3-51730fdd2622 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.238582 Dec 16 14:42:16.827821 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 218/449] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:16 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:17.000577 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bfd9d67c-35af-43a5-a5b8-eea0a307e6a9 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:17.001257 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bfd9d67c-35af-43a5-a5b8-eea0a307e6a9 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:17.010105 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bfd9d67c-35af-43a5-a5b8-eea0a307e6a9 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.010553 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bfd9d67c-35af-43a5-a5b8-eea0a307e6a9 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.011339 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bfd9d67c-35af-43a5-a5b8-eea0a307e6a9 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.011775 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bfd9d67c-35af-43a5-a5b8-eea0a307e6a9 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.069040 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c3139ab1-fb06-4492-ad75-afcfddabfadc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:17.069638 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c3139ab1-fb06-4492-ad75-afcfddabfadc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:17.077110 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c3139ab1-fb06-4492-ad75-afcfddabfadc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.077719 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c3139ab1-fb06-4492-ad75-afcfddabfadc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.078626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c3139ab1-fb06-4492-ad75-afcfddabfadc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.079217 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c3139ab1-fb06-4492-ad75-afcfddabfadc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.165491 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bfd9d67c-35af-43a5-a5b8-eea0a307e6a9 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:17.173932 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bfd9d67c-35af-43a5-a5b8-eea0a307e6a9 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.178026 Dec 16 14:42:17.174760 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 232/450] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:16 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:17.334172 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c3139ab1-fb06-4492-ad75-afcfddabfadc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:17.349880 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c3139ab1-fb06-4492-ad75-afcfddabfadc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.283963 Dec 16 14:42:17.352734 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 219/451] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:17 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:17.423725 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0355a507-0e3d-42c1-8069-68909f1048f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:17.424604 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0355a507-0e3d-42c1-8069-68909f1048f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:17.431867 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0355a507-0e3d-42c1-8069-68909f1048f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.432313 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0355a507-0e3d-42c1-8069-68909f1048f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.433105 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0355a507-0e3d-42c1-8069-68909f1048f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.433538 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0355a507-0e3d-42c1-8069-68909f1048f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.506052 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0355a507-0e3d-42c1-8069-68909f1048f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086226 Dec 16 14:42:17.510396 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 233/452] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:17 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:17.523953 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-55d6c96f-d7e9-49b7-9fd6-ec76ffb1ac76 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:17.524562 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-55d6c96f-d7e9-49b7-9fd6-ec76ffb1ac76 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:17.531953 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-55d6c96f-d7e9-49b7-9fd6-ec76ffb1ac76 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.532397 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-55d6c96f-d7e9-49b7-9fd6-ec76ffb1ac76 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.533220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-55d6c96f-d7e9-49b7-9fd6-ec76ffb1ac76 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.533659 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-55d6c96f-d7e9-49b7-9fd6-ec76ffb1ac76 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.727429 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-55d6c96f-d7e9-49b7-9fd6-ec76ffb1ac76 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:17.735790 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-55d6c96f-d7e9-49b7-9fd6-ec76ffb1ac76 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.215503 Dec 16 14:42:17.736420 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 220/453] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:17 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:17.845088 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5c8f9268-39dd-4330-842c-ff2a96966057 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:17.845729 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5c8f9268-39dd-4330-842c-ff2a96966057 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:17.853368 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c8f9268-39dd-4330-842c-ff2a96966057 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.853819 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c8f9268-39dd-4330-842c-ff2a96966057 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:17.854589 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c8f9268-39dd-4330-842c-ff2a96966057 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:17.855024 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c8f9268-39dd-4330-842c-ff2a96966057 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:18.063241 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5c8f9268-39dd-4330-842c-ff2a96966057 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:18.073281 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5c8f9268-39dd-4330-842c-ff2a96966057 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:18.074771 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5c8f9268-39dd-4330-842c-ff2a96966057 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:18.075874 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5c8f9268-39dd-4330-842c-ff2a96966057 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.234785 Dec 16 14:42:18.076415 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 234/454] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:17 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:18.199065 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f9d6dd07-3bc4-465b-a5cd-4f4ed2e36d16 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:18.199676 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f9d6dd07-3bc4-465b-a5cd-4f4ed2e36d16 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:18.207101 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f9d6dd07-3bc4-465b-a5cd-4f4ed2e36d16 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:18.207546 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f9d6dd07-3bc4-465b-a5cd-4f4ed2e36d16 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:18.208325 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f9d6dd07-3bc4-465b-a5cd-4f4ed2e36d16 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:18.208758 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f9d6dd07-3bc4-465b-a5cd-4f4ed2e36d16 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:18.333984 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f9d6dd07-3bc4-465b-a5cd-4f4ed2e36d16 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:18.342127 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f9d6dd07-3bc4-465b-a5cd-4f4ed2e36d16 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.153504 Dec 16 14:42:18.342690 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 221/455] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:18 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:18.369826 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b2f7848b-75cc-4dec-a4ba-c5b362ac756e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:18.370432 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b2f7848b-75cc-4dec-a4ba-c5b362ac756e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:18.378120 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b2f7848b-75cc-4dec-a4ba-c5b362ac756e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:18.378560 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b2f7848b-75cc-4dec-a4ba-c5b362ac756e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:18.379372 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b2f7848b-75cc-4dec-a4ba-c5b362ac756e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:18.379764 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b2f7848b-75cc-4dec-a4ba-c5b362ac756e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:18.517859 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-435676f9-de16-4c8f-ab40-fc1388b746b2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:18.519617 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-435676f9-de16-4c8f-ab40-fc1388b746b2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:18.527945 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-435676f9-de16-4c8f-ab40-fc1388b746b2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:18.528472 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-435676f9-de16-4c8f-ab40-fc1388b746b2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:18.529366 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-435676f9-de16-4c8f-ab40-fc1388b746b2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:18.529798 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-435676f9-de16-4c8f-ab40-fc1388b746b2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:18.595349 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b2f7848b-75cc-4dec-a4ba-c5b362ac756e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:18.599538 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-435676f9-de16-4c8f-ab40-fc1388b746b2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085604 Dec 16 14:42:18.600186 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 222/456] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:18 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:18.605246 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b2f7848b-75cc-4dec-a4ba-c5b362ac756e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.238939 Dec 16 14:42:18.605836 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 235/457] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:18 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:18.755454 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3ef081d9-f211-4b5b-8ac1-e2f4aa2e6c16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:18.756071 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3ef081d9-f211-4b5b-8ac1-e2f4aa2e6c16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:18.764978 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ef081d9-f211-4b5b-8ac1-e2f4aa2e6c16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:18.765508 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ef081d9-f211-4b5b-8ac1-e2f4aa2e6c16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:18.766374 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ef081d9-f211-4b5b-8ac1-e2f4aa2e6c16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:18.767075 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ef081d9-f211-4b5b-8ac1-e2f4aa2e6c16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:18.966010 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-3ef081d9-f211-4b5b-8ac1-e2f4aa2e6c16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:18.983080 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3ef081d9-f211-4b5b-8ac1-e2f4aa2e6c16 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.231653 Dec 16 14:42:18.984085 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 223/458] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:18 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:19.092809 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-eb753663-20e6-4cba-94e4-864ca62eb7d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:19.093454 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-eb753663-20e6-4cba-94e4-864ca62eb7d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:19.101153 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eb753663-20e6-4cba-94e4-864ca62eb7d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:19.101597 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eb753663-20e6-4cba-94e4-864ca62eb7d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.102351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eb753663-20e6-4cba-94e4-864ca62eb7d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:19.102779 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eb753663-20e6-4cba-94e4-864ca62eb7d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.312395 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-eb753663-20e6-4cba-94e4-864ca62eb7d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:19.321565 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-eb753663-20e6-4cba-94e4-864ca62eb7d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:19.323112 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-eb753663-20e6-4cba-94e4-864ca62eb7d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:19.324227 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-eb753663-20e6-4cba-94e4-864ca62eb7d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.235126 Dec 16 14:42:19.324797 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 236/459] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:19 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:19.359199 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-de07cf27-55e4-4f26-80a1-28a5303ec2ab tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:19.359807 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-de07cf27-55e4-4f26-80a1-28a5303ec2ab tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:19.367152 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de07cf27-55e4-4f26-80a1-28a5303ec2ab tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:19.367601 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de07cf27-55e4-4f26-80a1-28a5303ec2ab tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.368362 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de07cf27-55e4-4f26-80a1-28a5303ec2ab tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:19.368820 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de07cf27-55e4-4f26-80a1-28a5303ec2ab tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.491315 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-de07cf27-55e4-4f26-80a1-28a5303ec2ab tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:19.512140 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-de07cf27-55e4-4f26-80a1-28a5303ec2ab tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.156474 Dec 16 14:42:19.512733 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 224/460] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:19 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:19.611133 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ffd34493-4bdf-46c8-bc2d-b9c6c401ab5a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:19.612085 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ffd34493-4bdf-46c8-bc2d-b9c6c401ab5a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:19.619671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ffd34493-4bdf-46c8-bc2d-b9c6c401ab5a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:19.620126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ffd34493-4bdf-46c8-bc2d-b9c6c401ab5a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.620921 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ffd34493-4bdf-46c8-bc2d-b9c6c401ab5a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:19.621357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ffd34493-4bdf-46c8-bc2d-b9c6c401ab5a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.622652 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-379ae1ce-8715-4b17-83c7-09a6ded945f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:19.623256 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-379ae1ce-8715-4b17-83c7-09a6ded945f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:19.631060 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-379ae1ce-8715-4b17-83c7-09a6ded945f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:19.631531 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-379ae1ce-8715-4b17-83c7-09a6ded945f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.632314 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-379ae1ce-8715-4b17-83c7-09a6ded945f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:19.632718 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-379ae1ce-8715-4b17-83c7-09a6ded945f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:19.692255 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ffd34493-4bdf-46c8-bc2d-b9c6c401ab5a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084978 Dec 16 14:42:19.692871 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 237/461] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:19 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:20.008291 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b2a94f2f-39b7-45f1-a550-162bacec543b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:20.008946 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b2a94f2f-39b7-45f1-a550-162bacec543b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:20.009320 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-379ae1ce-8715-4b17-83c7-09a6ded945f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:20.017147 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b2a94f2f-39b7-45f1-a550-162bacec543b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.018533 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b2a94f2f-39b7-45f1-a550-162bacec543b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.019539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b2a94f2f-39b7-45f1-a550-162bacec543b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.019862 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-379ae1ce-8715-4b17-83c7-09a6ded945f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.400782 Dec 16 14:42:20.020415 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b2a94f2f-39b7-45f1-a550-162bacec543b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.029503 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 225/462] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:19 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:20.240994 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b2a94f2f-39b7-45f1-a550-162bacec543b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:20.249078 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b2a94f2f-39b7-45f1-a550-162bacec543b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.244816 Dec 16 14:42:20.249691 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 238/463] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:20 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:20.342570 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-cda5588f-e0ab-4e37-8ee4-2616af18e061 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:20.343186 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-cda5588f-e0ab-4e37-8ee4-2616af18e061 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:20.350301 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cda5588f-e0ab-4e37-8ee4-2616af18e061 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.350738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cda5588f-e0ab-4e37-8ee4-2616af18e061 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.351484 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cda5588f-e0ab-4e37-8ee4-2616af18e061 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.351911 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cda5588f-e0ab-4e37-8ee4-2616af18e061 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.529757 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f2dd1a46-aae6-4857-8f9c-cbecf1be1116 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:20.530261 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f2dd1a46-aae6-4857-8f9c-cbecf1be1116 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:20.538196 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f2dd1a46-aae6-4857-8f9c-cbecf1be1116 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.539052 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f2dd1a46-aae6-4857-8f9c-cbecf1be1116 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.539419 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f2dd1a46-aae6-4857-8f9c-cbecf1be1116 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.539854 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f2dd1a46-aae6-4857-8f9c-cbecf1be1116 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.552020 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-cda5588f-e0ab-4e37-8ee4-2616af18e061 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:20.561894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-cda5588f-e0ab-4e37-8ee4-2616af18e061 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:20.563539 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-cda5588f-e0ab-4e37-8ee4-2616af18e061 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:20.564660 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-cda5588f-e0ab-4e37-8ee4-2616af18e061 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.225828 Dec 16 14:42:20.565425 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 226/464] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:20 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:20.654070 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f2dd1a46-aae6-4857-8f9c-cbecf1be1116 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:20.662822 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f2dd1a46-aae6-4857-8f9c-cbecf1be1116 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.136879 Dec 16 14:42:20.663379 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 239/465] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:20 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:20.703512 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-155513e0-833d-4c12-8c67-9aa198f6ef59 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:20.704646 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-155513e0-833d-4c12-8c67-9aa198f6ef59 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:20.712344 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-155513e0-833d-4c12-8c67-9aa198f6ef59 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.712804 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-155513e0-833d-4c12-8c67-9aa198f6ef59 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.713605 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-155513e0-833d-4c12-8c67-9aa198f6ef59 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:20.714371 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-155513e0-833d-4c12-8c67-9aa198f6ef59 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:20.793785 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-155513e0-833d-4c12-8c67-9aa198f6ef59 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093969 Dec 16 14:42:20.794238 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 227/466] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:20 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:21.043523 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-eae70631-d392-4464-9bb8-bea356519e8e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:21.044340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-eae70631-d392-4464-9bb8-bea356519e8e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:21.052173 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eae70631-d392-4464-9bb8-bea356519e8e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:21.052617 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eae70631-d392-4464-9bb8-bea356519e8e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.053436 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eae70631-d392-4464-9bb8-bea356519e8e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:21.053868 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eae70631-d392-4464-9bb8-bea356519e8e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.252442 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-eae70631-d392-4464-9bb8-bea356519e8e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:21.260722 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-eae70631-d392-4464-9bb8-bea356519e8e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.225724 Dec 16 14:42:21.261299 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 240/467] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:21 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:21.269256 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-259d984b-37d1-4e43-ad35-eb843d6cf380 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:21.269863 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-259d984b-37d1-4e43-ad35-eb843d6cf380 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:21.277004 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-259d984b-37d1-4e43-ad35-eb843d6cf380 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:21.277460 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-259d984b-37d1-4e43-ad35-eb843d6cf380 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.278221 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-259d984b-37d1-4e43-ad35-eb843d6cf380 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:21.278660 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-259d984b-37d1-4e43-ad35-eb843d6cf380 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.477460 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-259d984b-37d1-4e43-ad35-eb843d6cf380 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:21.485945 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-259d984b-37d1-4e43-ad35-eb843d6cf380 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.221234 Dec 16 14:42:21.486599 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 228/468] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:21 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:21.584561 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b9ab29fa-31b8-4a7b-bcf8-964b1a62ba59 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:21.585503 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b9ab29fa-31b8-4a7b-bcf8-964b1a62ba59 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:21.592957 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b9ab29fa-31b8-4a7b-bcf8-964b1a62ba59 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:21.593406 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b9ab29fa-31b8-4a7b-bcf8-964b1a62ba59 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.594254 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b9ab29fa-31b8-4a7b-bcf8-964b1a62ba59 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:21.594706 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b9ab29fa-31b8-4a7b-bcf8-964b1a62ba59 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.679826 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4140b98b-8086-4fb2-a9e2-b995c9990314 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:21.680382 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4140b98b-8086-4fb2-a9e2-b995c9990314 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:21.687786 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4140b98b-8086-4fb2-a9e2-b995c9990314 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:21.688235 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4140b98b-8086-4fb2-a9e2-b995c9990314 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.689031 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4140b98b-8086-4fb2-a9e2-b995c9990314 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:21.690076 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4140b98b-8086-4fb2-a9e2-b995c9990314 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.813478 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4140b98b-8086-4fb2-a9e2-b995c9990314 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:21.825593 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4140b98b-8086-4fb2-a9e2-b995c9990314 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.149392 Dec 16 14:42:21.826357 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 229/469] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:21 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:21.834960 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4a5cade1-ec1f-42e2-b5aa-8967ad5311e6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:21.836046 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4a5cade1-ec1f-42e2-b5aa-8967ad5311e6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:21.843253 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4a5cade1-ec1f-42e2-b5aa-8967ad5311e6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:21.843712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4a5cade1-ec1f-42e2-b5aa-8967ad5311e6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.844489 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4a5cade1-ec1f-42e2-b5aa-8967ad5311e6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:21.844962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4a5cade1-ec1f-42e2-b5aa-8967ad5311e6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:21.863058 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b9ab29fa-31b8-4a7b-bcf8-964b1a62ba59 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:21.875549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b9ab29fa-31b8-4a7b-bcf8-964b1a62ba59 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:21.877185 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b9ab29fa-31b8-4a7b-bcf8-964b1a62ba59 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:21.878301 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b9ab29fa-31b8-4a7b-bcf8-964b1a62ba59 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.299122 Dec 16 14:42:21.879078 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 241/470] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:21 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:21.916562 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4a5cade1-ec1f-42e2-b5aa-8967ad5311e6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089334 Dec 16 14:42:21.917149 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 230/471] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:21 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:22.277857 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c3852e37-2189-4cf6-83c5-80c1865a6358 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:22.278489 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c3852e37-2189-4cf6-83c5-80c1865a6358 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:22.286136 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c3852e37-2189-4cf6-83c5-80c1865a6358 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.286586 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c3852e37-2189-4cf6-83c5-80c1865a6358 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.287398 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c3852e37-2189-4cf6-83c5-80c1865a6358 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.287866 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c3852e37-2189-4cf6-83c5-80c1865a6358 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.488280 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c3852e37-2189-4cf6-83c5-80c1865a6358 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:22.496489 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c3852e37-2189-4cf6-83c5-80c1865a6358 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.222340 Dec 16 14:42:22.497274 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 242/472] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:22 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:22.503535 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-303f398b-3644-497f-9c65-b6cb9cb47bbb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:22.504145 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-303f398b-3644-497f-9c65-b6cb9cb47bbb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:22.511666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-303f398b-3644-497f-9c65-b6cb9cb47bbb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.512276 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-303f398b-3644-497f-9c65-b6cb9cb47bbb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.513100 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-303f398b-3644-497f-9c65-b6cb9cb47bbb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.513537 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-303f398b-3644-497f-9c65-b6cb9cb47bbb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.790164 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-303f398b-3644-497f-9c65-b6cb9cb47bbb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:22.798161 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-303f398b-3644-497f-9c65-b6cb9cb47bbb tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.299062 Dec 16 14:42:22.799392 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 231/473] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:22 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:22.842940 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c1c6f855-250a-400e-8020-e3bf14722d85 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:22.843544 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c1c6f855-250a-400e-8020-e3bf14722d85 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:22.851309 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c1c6f855-250a-400e-8020-e3bf14722d85 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.851760 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c1c6f855-250a-400e-8020-e3bf14722d85 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.852526 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c1c6f855-250a-400e-8020-e3bf14722d85 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.852995 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c1c6f855-250a-400e-8020-e3bf14722d85 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.897013 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b5ead716-d5f2-4106-a860-a785070b28d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:22.897696 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b5ead716-d5f2-4106-a860-a785070b28d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:22.906585 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5ead716-d5f2-4106-a860-a785070b28d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.907069 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5ead716-d5f2-4106-a860-a785070b28d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.909162 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5ead716-d5f2-4106-a860-a785070b28d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.909588 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5ead716-d5f2-4106-a860-a785070b28d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.971501 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c1c6f855-250a-400e-8020-e3bf14722d85 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:22.980379 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c1c6f855-250a-400e-8020-e3bf14722d85 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.141198 Dec 16 14:42:22.981955 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 243/474] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:22 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:22.987550 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1cb74c6e-d385-45ae-b1eb-2c80107db082 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:22.988816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1cb74c6e-d385-45ae-b1eb-2c80107db082 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:22.996959 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1cb74c6e-d385-45ae-b1eb-2c80107db082 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.997332 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1cb74c6e-d385-45ae-b1eb-2c80107db082 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:22.998108 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1cb74c6e-d385-45ae-b1eb-2c80107db082 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:22.998541 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1cb74c6e-d385-45ae-b1eb-2c80107db082 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:23.067469 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1cb74c6e-d385-45ae-b1eb-2c80107db082 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084122 Dec 16 14:42:23.068296 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 244/475] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:22 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:23.124351 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b5ead716-d5f2-4106-a860-a785070b28d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:23.133490 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b5ead716-d5f2-4106-a860-a785070b28d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:23.134970 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b5ead716-d5f2-4106-a860-a785070b28d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:23.136074 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b5ead716-d5f2-4106-a860-a785070b28d8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.243145 Dec 16 14:42:23.136624 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 232/476] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:22 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:23.513562 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a1fff2da-5023-4fdb-b60e-76a257aab491 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:23.514154 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a1fff2da-5023-4fdb-b60e-76a257aab491 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:23.521595 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a1fff2da-5023-4fdb-b60e-76a257aab491 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:23.522034 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a1fff2da-5023-4fdb-b60e-76a257aab491 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:23.522791 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a1fff2da-5023-4fdb-b60e-76a257aab491 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:23.523217 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a1fff2da-5023-4fdb-b60e-76a257aab491 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:23.718844 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a1fff2da-5023-4fdb-b60e-76a257aab491 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:23.727444 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a1fff2da-5023-4fdb-b60e-76a257aab491 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.217485 Dec 16 14:42:23.728011 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 245/477] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:23 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:23.815767 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9c3289d1-780b-454f-9a21-60de21eec2cf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:23.816663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9c3289d1-780b-454f-9a21-60de21eec2cf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:23.824660 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9c3289d1-780b-454f-9a21-60de21eec2cf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:23.825138 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9c3289d1-780b-454f-9a21-60de21eec2cf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:23.825902 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9c3289d1-780b-454f-9a21-60de21eec2cf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:23.826335 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9c3289d1-780b-454f-9a21-60de21eec2cf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:23.998056 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-42db0fbd-1aca-480f-8676-2f04d4285304 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:23.998650 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-42db0fbd-1aca-480f-8676-2f04d4285304 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:24.005751 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-42db0fbd-1aca-480f-8676-2f04d4285304 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.006192 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-42db0fbd-1aca-480f-8676-2f04d4285304 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.006957 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-42db0fbd-1aca-480f-8676-2f04d4285304 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.007382 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-42db0fbd-1aca-480f-8676-2f04d4285304 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.022263 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9c3289d1-780b-454f-9a21-60de21eec2cf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:24.030445 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9c3289d1-780b-454f-9a21-60de21eec2cf tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.218552 Dec 16 14:42:24.031014 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 233/478] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:23 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:24.079216 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0e2c6836-5f54-4d7f-bb11-fe888edf4593 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:24.080676 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0e2c6836-5f54-4d7f-bb11-fe888edf4593 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:24.087977 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0e2c6836-5f54-4d7f-bb11-fe888edf4593 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.088423 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0e2c6836-5f54-4d7f-bb11-fe888edf4593 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.089214 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0e2c6836-5f54-4d7f-bb11-fe888edf4593 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.089642 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0e2c6836-5f54-4d7f-bb11-fe888edf4593 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.118630 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-42db0fbd-1aca-480f-8676-2f04d4285304 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:24.126771 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-42db0fbd-1aca-480f-8676-2f04d4285304 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1471 microversion: 2.1 time: 0.132342 Dec 16 14:42:24.127341 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 246/479] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:23 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1471 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:24.154638 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-241a5e98-4840-4124-8106-4f8f23695b8a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:24.155238 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-241a5e98-4840-4124-8106-4f8f23695b8a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:24.155800 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0e2c6836-5f54-4d7f-bb11-fe888edf4593 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080231 Dec 16 14:42:24.156362 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 234/480] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:24 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:24.163300 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-241a5e98-4840-4124-8106-4f8f23695b8a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.163746 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-241a5e98-4840-4124-8106-4f8f23695b8a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.164519 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-241a5e98-4840-4124-8106-4f8f23695b8a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.164984 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-241a5e98-4840-4124-8106-4f8f23695b8a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.357206 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-241a5e98-4840-4124-8106-4f8f23695b8a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:24.366173 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-241a5e98-4840-4124-8106-4f8f23695b8a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:24.367649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-241a5e98-4840-4124-8106-4f8f23695b8a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:24.368763 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-241a5e98-4840-4124-8106-4f8f23695b8a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.217741 Dec 16 14:42:24.369338 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 247/481] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:24 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:24.745388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e86b3d88-7b83-47e3-8407-5343927f8b5f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:24.745993 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e86b3d88-7b83-47e3-8407-5343927f8b5f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:24.753778 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e86b3d88-7b83-47e3-8407-5343927f8b5f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.754228 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e86b3d88-7b83-47e3-8407-5343927f8b5f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.754984 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e86b3d88-7b83-47e3-8407-5343927f8b5f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:24.755419 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e86b3d88-7b83-47e3-8407-5343927f8b5f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:24.956393 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e86b3d88-7b83-47e3-8407-5343927f8b5f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:24.965327 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e86b3d88-7b83-47e3-8407-5343927f8b5f tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.223616 Dec 16 14:42:24.966105 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 235/482] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:24 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:25.047607 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ead3d233-3ae1-4d44-820d-baeea48a1627 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:25.048206 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ead3d233-3ae1-4d44-820d-baeea48a1627 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:25.056145 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ead3d233-3ae1-4d44-820d-baeea48a1627 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.056692 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ead3d233-3ae1-4d44-820d-baeea48a1627 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.057591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ead3d233-3ae1-4d44-820d-baeea48a1627 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.058093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ead3d233-3ae1-4d44-820d-baeea48a1627 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.144167 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:25.144798 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:25.152248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.152548 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.153337 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.153785 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.223019 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.223465 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.223908 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lazy-loading 'fault' on Instance uuid 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:42:25.293853 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:25.302829 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b3b3cca1-71a1-452e-b90b-be3ec12c4e10 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 200 len: 1308 microversion: 2.1 time: 0.163301 Dec 16 14:42:25.303483 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 236/483] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:25 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:25.307944 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c6ae9f5f-fdab-498f-a50c-237df8d6cc1b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:25.309036 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c6ae9f5f-fdab-498f-a50c-237df8d6cc1b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:25.319766 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6ae9f5f-fdab-498f-a50c-237df8d6cc1b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.320273 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6ae9f5f-fdab-498f-a50c-237df8d6cc1b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.321102 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6ae9f5f-fdab-498f-a50c-237df8d6cc1b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.321490 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ead3d233-3ae1-4d44-820d-baeea48a1627 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:25.321626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6ae9f5f-fdab-498f-a50c-237df8d6cc1b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.329739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ead3d233-3ae1-4d44-820d-baeea48a1627 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1504 microversion: 2.1 time: 0.286112 Dec 16 14:42:25.330310 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 248/484] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:25 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:25.387140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-6b7540a7-8193-4a3f-b663-c7d279178df5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:25.387741 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-6b7540a7-8193-4a3f-b663-c7d279178df5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:25.389318 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c6ae9f5f-fdab-498f-a50c-237df8d6cc1b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084713 Dec 16 14:42:25.389884 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 237/485] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:42:25 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:42:25.395537 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6b7540a7-8193-4a3f-b663-c7d279178df5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.395988 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6b7540a7-8193-4a3f-b663-c7d279178df5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.396760 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6b7540a7-8193-4a3f-b663-c7d279178df5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.397219 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6b7540a7-8193-4a3f-b663-c7d279178df5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.602674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2107583840", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "networks": [{"uuid": "80a0dcd7-59dc-485e-9feb-7d18fa3c28f8"}]}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:25.674233 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] validate_networks() for [('80a0dcd7-59dc-485e-9feb-7d18fa3c28f8', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:42:25.826154 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6b7540a7-8193-4a3f-b663-c7d279178df5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:25.839548 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6b7540a7-8193-4a3f-b663-c7d279178df5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:25.841080 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6b7540a7-8193-4a3f-b663-c7d279178df5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:25.842228 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-6b7540a7-8193-4a3f-b663-c7d279178df5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.458776 Dec 16 14:42:25.843012 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 249/486] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:25 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:25.981780 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4d72b236-4aab-4d14-b292-7f6bd2fd8b2b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:25.982387 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4d72b236-4aab-4d14-b292-7f6bd2fd8b2b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:25.990467 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d72b236-4aab-4d14-b292-7f6bd2fd8b2b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.990913 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d72b236-4aab-4d14-b292-7f6bd2fd8b2b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:25.991831 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d72b236-4aab-4d14-b292-7f6bd2fd8b2b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:25.992275 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d72b236-4aab-4d14-b292-7f6bd2fd8b2b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:26.660899 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4d72b236-4aab-4d14-b292-7f6bd2fd8b2b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:26.669313 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4d72b236-4aab-4d14-b292-7f6bd2fd8b2b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.691774 Dec 16 14:42:26.669982 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 250/487] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:25 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:26.683372 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5c64a761-5c8e-4526-923a-dff6a51c8209 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:26.684699 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5c64a761-5c8e-4526-923a-dff6a51c8209 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:26.691688 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c64a761-5c8e-4526-923a-dff6a51c8209 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:26.692140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c64a761-5c8e-4526-923a-dff6a51c8209 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:26.692940 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c64a761-5c8e-4526-923a-dff6a51c8209 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:26.693376 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c64a761-5c8e-4526-923a-dff6a51c8209 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:26.746714 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-5c64a761-5c8e-4526-923a-dff6a51c8209 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] HTTP exception thrown: Instance 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 could not be found. Dec 16 14:42:26.747230 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5c64a761-5c8e-4526-923a-dff6a51c8209 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Returning 404 to user: Instance 0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:42:26.748074 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5c64a761-5c8e-4526-923a-dff6a51c8209 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2" status: 404 len: 111 microversion: 2.1 time: 0.068287 Dec 16 14:42:26.748834 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 251/488] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:26 2021] GET /compute/v2.1/servers/0f59e7d9-2df3-4788-a597-ff7dd7c2acc2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:26.760295 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1e44fc7d-6dd9-4b05-ab24-38b2ea368902 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:26.760295 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1e44fc7d-6dd9-4b05-ab24-38b2ea368902 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:26.766005 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1e44fc7d-6dd9-4b05-ab24-38b2ea368902 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:26.766718 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1e44fc7d-6dd9-4b05-ab24-38b2ea368902 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:26.768444 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1e44fc7d-6dd9-4b05-ab24-38b2ea368902 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:26.768532 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1e44fc7d-6dd9-4b05-ab24-38b2ea368902 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:26.981653 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1e44fc7d-6dd9-4b05-ab24-38b2ea368902 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:26.997188 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1e44fc7d-6dd9-4b05-ab24-38b2ea368902 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1462 microversion: 2.1 time: 0.247376 Dec 16 14:42:26.997770 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 252/489] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:26 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1462 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:27.003012 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-871ae55a-0dc3-4f4c-8954-92f3ff8c7f73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:27.003682 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-871ae55a-0dc3-4f4c-8954-92f3ff8c7f73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:27.011210 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-871ae55a-0dc3-4f4c-8954-92f3ff8c7f73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:27.011728 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-871ae55a-0dc3-4f4c-8954-92f3ff8c7f73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:27.012599 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-871ae55a-0dc3-4f4c-8954-92f3ff8c7f73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:27.013126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-871ae55a-0dc3-4f4c-8954-92f3ff8c7f73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:27.066689 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:42:27.067204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:42:27.067856 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:42:27.068666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:42:27.069154 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:42:27.078201 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:27.078897 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:27.079911 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:27.080596 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:27.100607 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Getting quotas for project 5a10c6d1e7e7425bb59f6efad4231db3. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:42:27.104623 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Getting quotas for user eeb2dde456a8408d820d765c54f8a868 and project 5a10c6d1e7e7425bb59f6efad4231db3. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:42:27.115820 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:42:27.118256 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:42:27.183944 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-baa8a14f-6bc2-4fce-808d-bfe27a87bdf5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.586128 Dec 16 14:42:27.189980 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 238/490] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:42:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:42:27.195806 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-d261bbab-1d13-40f7-ae81-aec6cfab8133 req-41179d4f-64c0-4d90-97b2-133d3c482d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa8e3a5-f077-4adf-bbcf-1f61da473268", "name": "network-vif-deleted", "tag": "8e60955b-ae1a-42f6-b082-cf2f17620025"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:27.197469 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:27.197469 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:42:27.213546 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-d261bbab-1d13-40f7-ae81-aec6cfab8133 req-41179d4f-64c0-4d90-97b2-133d3c482d0c service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:27.214287 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-d261bbab-1d13-40f7-ae81-aec6cfab8133 req-41179d4f-64c0-4d90-97b2-133d3c482d0c service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:27.233473 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-d261bbab-1d13-40f7-ae81-aec6cfab8133 req-41179d4f-64c0-4d90-97b2-133d3c482d0c service nova] Creating event network-vif-deleted:8e60955b-ae1a-42f6-b082-cf2f17620025 for instance eaa8e3a5-f077-4adf-bbcf-1f61da473268 on hv-cinder-82189 Dec 16 14:42:27.239600 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-d261bbab-1d13-40f7-ae81-aec6cfab8133 req-41179d4f-64c0-4d90-97b2-133d3c482d0c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049360 Dec 16 14:42:27.240398 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 239/491] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:27.247779 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5ce6b7f4-2638-415e-8945-2d71cc9cf708 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:27.248869 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5ce6b7f4-2638-415e-8945-2d71cc9cf708 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:27.338220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5ce6b7f4-2638-415e-8945-2d71cc9cf708 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:27.343115 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-871ae55a-0dc3-4f4c-8954-92f3ff8c7f73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:27.347183 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5ce6b7f4-2638-415e-8945-2d71cc9cf708 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1218 microversion: 2.1 time: 0.105396 Dec 16 14:42:27.348284 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 240/492] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:27 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:27.354094 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-871ae55a-0dc3-4f4c-8954-92f3ff8c7f73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:27.355810 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-871ae55a-0dc3-4f4c-8954-92f3ff8c7f73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:27.356973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-871ae55a-0dc3-4f4c-8954-92f3ff8c7f73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.358172 Dec 16 14:42:27.357507 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 253/493] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:26 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:27.686404 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-10f50925-6cbb-477b-8641-1cd4ad5274bc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:27.687013 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-10f50925-6cbb-477b-8641-1cd4ad5274bc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:27.695125 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-10f50925-6cbb-477b-8641-1cd4ad5274bc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:27.695575 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-10f50925-6cbb-477b-8641-1cd4ad5274bc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:27.696348 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-10f50925-6cbb-477b-8641-1cd4ad5274bc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:27.696803 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-10f50925-6cbb-477b-8641-1cd4ad5274bc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:27.891716 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-10f50925-6cbb-477b-8641-1cd4ad5274bc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:27.900344 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-10f50925-6cbb-477b-8641-1cd4ad5274bc tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.217672 Dec 16 14:42:27.900940 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 241/494] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:27 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:28.014678 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:28.015276 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:28.023334 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.023773 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:28.024544 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.025000 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:28.102733 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.103257 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:28.103829 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lazy-loading 'fault' on Instance uuid eaa8e3a5-f077-4adf-bbcf-1f61da473268 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:42:28.176716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:28.184885 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-6b428793-0b6f-4ca2-ab84-bbd5a2ff9b2d tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1303 microversion: 2.1 time: 0.173865 Dec 16 14:42:28.185372 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 254/495] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:28 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1303 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:28.365324 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-25fb2d96-49fc-42f4-8c03-af6d07bfb399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:28.365881 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-25fb2d96-49fc-42f4-8c03-af6d07bfb399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:28.373175 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-25fb2d96-49fc-42f4-8c03-af6d07bfb399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.373624 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-25fb2d96-49fc-42f4-8c03-af6d07bfb399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:28.374415 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-25fb2d96-49fc-42f4-8c03-af6d07bfb399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.374844 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-25fb2d96-49fc-42f4-8c03-af6d07bfb399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:28.375196 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9aa487fe-42b1-416d-9009-6a924297fbf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:28.375805 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9aa487fe-42b1-416d-9009-6a924297fbf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:28.383648 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9aa487fe-42b1-416d-9009-6a924297fbf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.384097 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9aa487fe-42b1-416d-9009-6a924297fbf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:28.384903 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9aa487fe-42b1-416d-9009-6a924297fbf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.385340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9aa487fe-42b1-416d-9009-6a924297fbf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:28.520179 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-25fb2d96-49fc-42f4-8c03-af6d07bfb399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:28.528465 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-25fb2d96-49fc-42f4-8c03-af6d07bfb399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1222 microversion: 2.1 time: 0.167654 Dec 16 14:42:28.529064 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 242/496] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:28 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:28.611879 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9aa487fe-42b1-416d-9009-6a924297fbf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:28.621349 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9aa487fe-42b1-416d-9009-6a924297fbf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:28.622786 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9aa487fe-42b1-416d-9009-6a924297fbf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:28.623899 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9aa487fe-42b1-416d-9009-6a924297fbf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.252395 Dec 16 14:42:28.624442 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 255/497] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:28 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:28.917878 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ef10d752-2779-43f0-8113-7b55891f4d92 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:28.918512 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ef10d752-2779-43f0-8113-7b55891f4d92 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:28.926638 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ef10d752-2779-43f0-8113-7b55891f4d92 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.927166 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ef10d752-2779-43f0-8113-7b55891f4d92 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:28.927953 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ef10d752-2779-43f0-8113-7b55891f4d92 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:28.928410 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ef10d752-2779-43f0-8113-7b55891f4d92 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:29.121682 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ef10d752-2779-43f0-8113-7b55891f4d92 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:29.130231 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ef10d752-2779-43f0-8113-7b55891f4d92 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.216038 Dec 16 14:42:29.130888 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 243/498] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:28 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:29.201947 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:29.202665 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:29.210777 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:29.211221 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:29.211991 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:29.212416 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:29.279837 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:29.280274 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:29.280715 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lazy-loading 'fault' on Instance uuid eaa8e3a5-f077-4adf-bbcf-1f61da473268 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:42:29.339605 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:29.348262 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-36289a92-ec95-4193-a5c9-96818001a937 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1303 microversion: 2.1 time: 0.150001 Dec 16 14:42:29.348863 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 256/499] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:29 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:29.544590 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ec56f067-6a15-482e-9643-42cf1cf251bc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:29.545194 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ec56f067-6a15-482e-9643-42cf1cf251bc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:29.552501 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ec56f067-6a15-482e-9643-42cf1cf251bc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:29.552998 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ec56f067-6a15-482e-9643-42cf1cf251bc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:29.553764 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ec56f067-6a15-482e-9643-42cf1cf251bc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:29.554198 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ec56f067-6a15-482e-9643-42cf1cf251bc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:29.642900 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3b0ed598-7e7b-4d4d-b6b1-64930bb341d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:29.643520 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3b0ed598-7e7b-4d4d-b6b1-64930bb341d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:29.650775 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b0ed598-7e7b-4d4d-b6b1-64930bb341d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:29.651219 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b0ed598-7e7b-4d4d-b6b1-64930bb341d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:29.651987 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b0ed598-7e7b-4d4d-b6b1-64930bb341d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:29.652418 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b0ed598-7e7b-4d4d-b6b1-64930bb341d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:29.664954 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ec56f067-6a15-482e-9643-42cf1cf251bc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:29.673072 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ec56f067-6a15-482e-9643-42cf1cf251bc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1222 microversion: 2.1 time: 0.132197 Dec 16 14:42:29.673646 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 244/500] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:29 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:29.847802 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3b0ed598-7e7b-4d4d-b6b1-64930bb341d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:29.857163 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3b0ed598-7e7b-4d4d-b6b1-64930bb341d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:29.858711 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3b0ed598-7e7b-4d4d-b6b1-64930bb341d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:29.859917 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3b0ed598-7e7b-4d4d-b6b1-64930bb341d7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.221559 Dec 16 14:42:29.860382 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 257/501] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:29 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:30.146773 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-87e6133d-ccad-41c3-a5e0-070d3a9173a1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:30.147375 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-87e6133d-ccad-41c3-a5e0-070d3a9173a1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:30.154967 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87e6133d-ccad-41c3-a5e0-070d3a9173a1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:30.155405 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87e6133d-ccad-41c3-a5e0-070d3a9173a1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:30.156190 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87e6133d-ccad-41c3-a5e0-070d3a9173a1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:30.156620 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87e6133d-ccad-41c3-a5e0-070d3a9173a1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:30.357354 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-87e6133d-ccad-41c3-a5e0-070d3a9173a1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:30.365283 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:30.366004 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:30.366469 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-87e6133d-ccad-41c3-a5e0-070d3a9173a1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.223380 Dec 16 14:42:30.367209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 245/502] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:30 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:30.373556 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:30.374004 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:30.374833 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:30.375456 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:30.443710 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:30.444182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:30.444670 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lazy-loading 'fault' on Instance uuid eaa8e3a5-f077-4adf-bbcf-1f61da473268 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:42:30.502520 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4047bb1e8e42099d2263ee1322450d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0a8f8b2ba340f1b5d3aacb9646f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:30.511511 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3d593601-c3f4-4652-81d1-55b300d14d7b tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 200 len: 1303 microversion: 2.1 time: 0.150584 Dec 16 14:42:30.512411 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 258/503] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:30 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:30.689588 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-29ac17ba-e6d8-444d-999e-ea4a5cb923d2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:30.690193 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-29ac17ba-e6d8-444d-999e-ea4a5cb923d2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:30.697281 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-29ac17ba-e6d8-444d-999e-ea4a5cb923d2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:30.697721 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-29ac17ba-e6d8-444d-999e-ea4a5cb923d2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:30.698472 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-29ac17ba-e6d8-444d-999e-ea4a5cb923d2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:30.698894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-29ac17ba-e6d8-444d-999e-ea4a5cb923d2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:30.877530 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-000cc2e9-f223-4174-b5fa-d6195351524e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:30.878140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-000cc2e9-f223-4174-b5fa-d6195351524e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:30.878269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-29ac17ba-e6d8-444d-999e-ea4a5cb923d2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:30.886620 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-29ac17ba-e6d8-444d-999e-ea4a5cb923d2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1270 microversion: 2.1 time: 0.200655 Dec 16 14:42:30.887188 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 246/504] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:30 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:30.890188 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-000cc2e9-f223-4174-b5fa-d6195351524e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:30.890637 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-000cc2e9-f223-4174-b5fa-d6195351524e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:30.891667 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-000cc2e9-f223-4174-b5fa-d6195351524e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:30.892594 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-000cc2e9-f223-4174-b5fa-d6195351524e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:31.206166 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-000cc2e9-f223-4174-b5fa-d6195351524e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:31.219901 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-000cc2e9-f223-4174-b5fa-d6195351524e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:31.221472 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-000cc2e9-f223-4174-b5fa-d6195351524e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:31.222637 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-000cc2e9-f223-4174-b5fa-d6195351524e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.348806 Dec 16 14:42:31.226451 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 259/505] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:30 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:31.382650 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a88f5f90-2423-4fbc-88ad-ebee4407fc42 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:31.383261 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a88f5f90-2423-4fbc-88ad-ebee4407fc42 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:31.392150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a88f5f90-2423-4fbc-88ad-ebee4407fc42 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:31.392150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a88f5f90-2423-4fbc-88ad-ebee4407fc42 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:31.393050 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a88f5f90-2423-4fbc-88ad-ebee4407fc42 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:31.393457 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a88f5f90-2423-4fbc-88ad-ebee4407fc42 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:31.529890 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-af0aee8e-ce43-47a6-8709-722c1adeb951 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:31.530589 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-af0aee8e-ce43-47a6-8709-722c1adeb951 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] [instance: eaa8e3a5-f077-4adf-bbcf-1f61da473268] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:31.554590 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-af0aee8e-ce43-47a6-8709-722c1adeb951 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:31.555333 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-af0aee8e-ce43-47a6-8709-722c1adeb951 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:31.556346 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-af0aee8e-ce43-47a6-8709-722c1adeb951 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:31.557164 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-af0aee8e-ce43-47a6-8709-722c1adeb951 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:31.615088 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-af0aee8e-ce43-47a6-8709-722c1adeb951 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] HTTP exception thrown: Instance eaa8e3a5-f077-4adf-bbcf-1f61da473268 could not be found. Dec 16 14:42:31.615685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-af0aee8e-ce43-47a6-8709-722c1adeb951 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] Returning 404 to user: Instance eaa8e3a5-f077-4adf-bbcf-1f61da473268 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:42:31.616512 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-af0aee8e-ce43-47a6-8709-722c1adeb951 tempest-VolumesActionsTest-1977218571 tempest-VolumesActionsTest-1977218571-project] 10.222.0.64 "GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268" status: 404 len: 111 microversion: 2.1 time: 0.091449 Dec 16 14:42:31.617109 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 260/506] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:31 2021] GET /compute/v2.1/servers/eaa8e3a5-f077-4adf-bbcf-1f61da473268 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:31.864886 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-a88f5f90-2423-4fbc-88ad-ebee4407fc42 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:31.879056 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a88f5f90-2423-4fbc-88ad-ebee4407fc42 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 200 len: 1509 microversion: 2.1 time: 0.499921 Dec 16 14:42:31.879651 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 247/507] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:31 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 1509 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:31.904865 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9f4bcbbd-54b0-4f9c-8ecf-08c08056b03b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:31.905659 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9f4bcbbd-54b0-4f9c-8ecf-08c08056b03b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:31.922429 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9f4bcbbd-54b0-4f9c-8ecf-08c08056b03b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:31.923037 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9f4bcbbd-54b0-4f9c-8ecf-08c08056b03b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:31.924691 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9f4bcbbd-54b0-4f9c-8ecf-08c08056b03b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:31.926025 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9f4bcbbd-54b0-4f9c-8ecf-08c08056b03b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:32.025649 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-f31abbac-4832-414a-b0bf-7e893ede8036 req-55a55a3b-1787-43a4-bfeb-86a2bf4e9c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d89b92-839c-4c63-ae4d-71c0a98797ea", "name": "network-vif-deleted", "tag": "9f4e36fb-6721-4f46-ae0e-4c3561ce55f0"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:32.027655 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:32.027655 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:42:32.043060 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-f31abbac-4832-414a-b0bf-7e893ede8036 req-55a55a3b-1787-43a4-bfeb-86a2bf4e9c3b service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:32.047891 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-f31abbac-4832-414a-b0bf-7e893ede8036 req-55a55a3b-1787-43a4-bfeb-86a2bf4e9c3b service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:32.084188 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-f31abbac-4832-414a-b0bf-7e893ede8036 req-55a55a3b-1787-43a4-bfeb-86a2bf4e9c3b service nova] Creating event network-vif-deleted:9f4e36fb-6721-4f46-ae0e-4c3561ce55f0 for instance 55d89b92-839c-4c63-ae4d-71c0a98797ea on hv-cinder-82189 Dec 16 14:42:32.098475 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-f31abbac-4832-414a-b0bf-7e893ede8036 req-55a55a3b-1787-43a4-bfeb-86a2bf4e9c3b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076262 Dec 16 14:42:32.099247 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 248/508] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:32.121579 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9f4bcbbd-54b0-4f9c-8ecf-08c08056b03b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:32.130887 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9f4bcbbd-54b0-4f9c-8ecf-08c08056b03b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1276 microversion: 2.1 time: 0.230179 Dec 16 14:42:32.137059 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 261/509] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:31 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:32.245382 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8eeeb88e-3d98-4b11-b228-1d5a4b137935 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:32.246145 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8eeeb88e-3d98-4b11-b228-1d5a4b137935 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:32.255582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8eeeb88e-3d98-4b11-b228-1d5a4b137935 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:32.256271 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8eeeb88e-3d98-4b11-b228-1d5a4b137935 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:32.257169 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8eeeb88e-3d98-4b11-b228-1d5a4b137935 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:32.257605 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8eeeb88e-3d98-4b11-b228-1d5a4b137935 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:32.480025 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8eeeb88e-3d98-4b11-b228-1d5a4b137935 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:32.490710 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8eeeb88e-3d98-4b11-b228-1d5a4b137935 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:32.492541 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8eeeb88e-3d98-4b11-b228-1d5a4b137935 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:32.493912 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8eeeb88e-3d98-4b11-b228-1d5a4b137935 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.254200 Dec 16 14:42:32.494795 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 249/510] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:32 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:32.897112 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f1b687f6-d4b3-43be-b40d-9a036d8f2eb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:32.897895 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f1b687f6-d4b3-43be-b40d-9a036d8f2eb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 55d89b92-839c-4c63-ae4d-71c0a98797ea] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:32.917701 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f1b687f6-d4b3-43be-b40d-9a036d8f2eb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:32.918934 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f1b687f6-d4b3-43be-b40d-9a036d8f2eb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:32.924525 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f1b687f6-d4b3-43be-b40d-9a036d8f2eb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:32.924993 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f1b687f6-d4b3-43be-b40d-9a036d8f2eb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:32.985218 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-f1b687f6-d4b3-43be-b40d-9a036d8f2eb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] HTTP exception thrown: Instance 55d89b92-839c-4c63-ae4d-71c0a98797ea could not be found. Dec 16 14:42:32.986286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f1b687f6-d4b3-43be-b40d-9a036d8f2eb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Returning 404 to user: Instance 55d89b92-839c-4c63-ae4d-71c0a98797ea could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:42:32.987712 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f1b687f6-d4b3-43be-b40d-9a036d8f2eb9 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea" status: 404 len: 111 microversion: 2.1 time: 0.095564 Dec 16 14:42:32.991758 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 262/511] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:32 2021] GET /compute/v2.1/servers/55d89b92-839c-4c63-ae4d-71c0a98797ea => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:32.998042 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ff144528-057f-4b25-9959-42a4889d3c02 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:32.999150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ff144528-057f-4b25-9959-42a4889d3c02 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:33.008592 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ff144528-057f-4b25-9959-42a4889d3c02 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.009176 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ff144528-057f-4b25-9959-42a4889d3c02 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.010057 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ff144528-057f-4b25-9959-42a4889d3c02 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.010642 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ff144528-057f-4b25-9959-42a4889d3c02 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.101292 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ff144528-057f-4b25-9959-42a4889d3c02 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:42:33.148860 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9d3a6201-cf33-484d-a7b8-78efbb8d54bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:33.149927 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9d3a6201-cf33-484d-a7b8-78efbb8d54bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:33.165812 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d3a6201-cf33-484d-a7b8-78efbb8d54bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.167827 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d3a6201-cf33-484d-a7b8-78efbb8d54bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.172822 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d3a6201-cf33-484d-a7b8-78efbb8d54bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.173404 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d3a6201-cf33-484d-a7b8-78efbb8d54bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.248296 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ff144528-057f-4b25-9959-42a4889d3c02 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 204 len: 0 microversion: 2.1 time: 0.254536 Dec 16 14:42:33.253276 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 250/512] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:42:32 2021] DELETE /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:42:33.259662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c5b2b87f-ed90-4c14-9fe4-2bce2862a3e1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:33.260551 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c5b2b87f-ed90-4c14-9fe4-2bce2862a3e1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:33.271188 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c5b2b87f-ed90-4c14-9fe4-2bce2862a3e1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.271782 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c5b2b87f-ed90-4c14-9fe4-2bce2862a3e1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.272665 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c5b2b87f-ed90-4c14-9fe4-2bce2862a3e1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.273223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c5b2b87f-ed90-4c14-9fe4-2bce2862a3e1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.479669 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9d3a6201-cf33-484d-a7b8-78efbb8d54bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:33.488610 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9d3a6201-cf33-484d-a7b8-78efbb8d54bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.343863 Dec 16 14:42:33.489435 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 263/513] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:33 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:33.511322 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-15fd3247-3752-41dc-a039-c7c47d15b981 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:33.512196 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-15fd3247-3752-41dc-a039-c7c47d15b981 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:33.520240 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-15fd3247-3752-41dc-a039-c7c47d15b981 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.520765 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-15fd3247-3752-41dc-a039-c7c47d15b981 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.521795 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-15fd3247-3752-41dc-a039-c7c47d15b981 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.522447 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-15fd3247-3752-41dc-a039-c7c47d15b981 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.578043 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c5b2b87f-ed90-4c14-9fe4-2bce2862a3e1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:33.588179 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c5b2b87f-ed90-4c14-9fe4-2bce2862a3e1 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.333243 Dec 16 14:42:33.589517 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 251/514] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:33 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:33.719830 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-0e6d853c-6527-4303-b72d-a0ffe7a3723d req-82053d3b-657c-4b8f-b632-7da889c0ca87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852bc07c-edbd-4753-8055-d84a33315464", "tag": "526505bf-e823-46fa-a1a2-6e5aff27c04f"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:33.722365 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:33.722365 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:42:33.728552 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-15fd3247-3752-41dc-a039-c7c47d15b981 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:33.735119 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-0e6d853c-6527-4303-b72d-a0ffe7a3723d req-82053d3b-657c-4b8f-b632-7da889c0ca87 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:33.735505 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-0e6d853c-6527-4303-b72d-a0ffe7a3723d req-82053d3b-657c-4b8f-b632-7da889c0ca87 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:33.739217 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-15fd3247-3752-41dc-a039-c7c47d15b981 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:33.741473 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-15fd3247-3752-41dc-a039-c7c47d15b981 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:33.742752 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-15fd3247-3752-41dc-a039-c7c47d15b981 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.235218 Dec 16 14:42:33.743438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 264/515] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:33 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:33.755075 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-0e6d853c-6527-4303-b72d-a0ffe7a3723d req-82053d3b-657c-4b8f-b632-7da889c0ca87 service nova] Creating event network-changed:526505bf-e823-46fa-a1a2-6e5aff27c04f for instance 852bc07c-edbd-4753-8055-d84a33315464 on hv-cinder-82189 Dec 16 14:42:33.759588 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-0e6d853c-6527-4303-b72d-a0ffe7a3723d req-82053d3b-657c-4b8f-b632-7da889c0ca87 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043417 Dec 16 14:42:33.760158 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 252/516] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:34.505503 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9bead4b9-d2f4-4041-9628-040007b996eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:34.506083 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9bead4b9-d2f4-4041-9628-040007b996eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:34.513233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9bead4b9-d2f4-4041-9628-040007b996eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:34.513674 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9bead4b9-d2f4-4041-9628-040007b996eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:34.514421 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9bead4b9-d2f4-4041-9628-040007b996eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:34.514854 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9bead4b9-d2f4-4041-9628-040007b996eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:34.605548 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2727790c-a76c-4697-8695-80106d4e3bae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:34.606244 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2727790c-a76c-4697-8695-80106d4e3bae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:34.613992 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2727790c-a76c-4697-8695-80106d4e3bae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:34.614435 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2727790c-a76c-4697-8695-80106d4e3bae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:34.615204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2727790c-a76c-4697-8695-80106d4e3bae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:34.615634 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2727790c-a76c-4697-8695-80106d4e3bae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:34.813294 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9bead4b9-d2f4-4041-9628-040007b996eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:34.824001 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9bead4b9-d2f4-4041-9628-040007b996eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.322094 Dec 16 14:42:34.834414 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 265/517] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:34 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:34.834414 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f7cb5bcb-12b6-4454-8745-fe340cac5c88 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:34.834414 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f7cb5bcb-12b6-4454-8745-fe340cac5c88 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:34.838014 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f7cb5bcb-12b6-4454-8745-fe340cac5c88 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:34.838464 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f7cb5bcb-12b6-4454-8745-fe340cac5c88 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:34.839241 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f7cb5bcb-12b6-4454-8745-fe340cac5c88 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:34.839671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f7cb5bcb-12b6-4454-8745-fe340cac5c88 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:34.889297 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2727790c-a76c-4697-8695-80106d4e3bae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:34.898274 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2727790c-a76c-4697-8695-80106d4e3bae tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.296775 Dec 16 14:42:34.898835 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 253/518] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:34 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:35.033639 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f7cb5bcb-12b6-4454-8745-fe340cac5c88 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:35.043768 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f7cb5bcb-12b6-4454-8745-fe340cac5c88 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:35.045518 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f7cb5bcb-12b6-4454-8745-fe340cac5c88 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:35.047308 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f7cb5bcb-12b6-4454-8745-fe340cac5c88 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.221347 Dec 16 14:42:35.047902 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 266/519] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:34 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:35.841714 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-95186113-a3fb-4d34-bff3-36706457ac63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:35.842317 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-95186113-a3fb-4d34-bff3-36706457ac63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:35.850387 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-95186113-a3fb-4d34-bff3-36706457ac63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:35.850817 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-95186113-a3fb-4d34-bff3-36706457ac63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:35.851556 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-95186113-a3fb-4d34-bff3-36706457ac63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:35.851981 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-95186113-a3fb-4d34-bff3-36706457ac63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:35.914938 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e2aa4e18-14a9-4a04-bddf-9e2dbdbe7334 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:35.915545 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e2aa4e18-14a9-4a04-bddf-9e2dbdbe7334 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:35.922836 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e2aa4e18-14a9-4a04-bddf-9e2dbdbe7334 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:35.924252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e2aa4e18-14a9-4a04-bddf-9e2dbdbe7334 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:35.925068 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e2aa4e18-14a9-4a04-bddf-9e2dbdbe7334 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:35.925507 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e2aa4e18-14a9-4a04-bddf-9e2dbdbe7334 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:36.097060 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-95186113-a3fb-4d34-bff3-36706457ac63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:36.104951 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-95186113-a3fb-4d34-bff3-36706457ac63 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.266990 Dec 16 14:42:36.105611 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 254/520] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:35 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:36.109951 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-768e4328-cf55-4723-ba78-1d82527c74d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:36.110607 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-768e4328-cf55-4723-ba78-1d82527c74d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:36.119712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-768e4328-cf55-4723-ba78-1d82527c74d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:36.120286 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-768e4328-cf55-4723-ba78-1d82527c74d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:36.121202 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-768e4328-cf55-4723-ba78-1d82527c74d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:36.121858 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-768e4328-cf55-4723-ba78-1d82527c74d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:36.176273 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e2aa4e18-14a9-4a04-bddf-9e2dbdbe7334 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:36.185606 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e2aa4e18-14a9-4a04-bddf-9e2dbdbe7334 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.274136 Dec 16 14:42:36.186401 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 267/521] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:35 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:36.326052 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-768e4328-cf55-4723-ba78-1d82527c74d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:36.335839 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-768e4328-cf55-4723-ba78-1d82527c74d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:36.337359 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-768e4328-cf55-4723-ba78-1d82527c74d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:36.338463 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-768e4328-cf55-4723-ba78-1d82527c74d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.232009 Dec 16 14:42:36.339008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 255/522] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:36 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:37.121797 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0fd4f458-46d2-4941-9e34-a6002581070b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:37.122396 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0fd4f458-46d2-4941-9e34-a6002581070b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:37.129686 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0fd4f458-46d2-4941-9e34-a6002581070b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:37.130131 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0fd4f458-46d2-4941-9e34-a6002581070b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:37.130914 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0fd4f458-46d2-4941-9e34-a6002581070b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:37.131361 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0fd4f458-46d2-4941-9e34-a6002581070b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:37.203232 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-97395cc6-0618-44e9-a82c-51ec5d736b8b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:37.204151 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-97395cc6-0618-44e9-a82c-51ec5d736b8b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:37.211710 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-97395cc6-0618-44e9-a82c-51ec5d736b8b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:37.212266 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-97395cc6-0618-44e9-a82c-51ec5d736b8b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:37.213185 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-97395cc6-0618-44e9-a82c-51ec5d736b8b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:37.213717 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-97395cc6-0618-44e9-a82c-51ec5d736b8b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:37.383022 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0fd4f458-46d2-4941-9e34-a6002581070b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:37.391519 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0fd4f458-46d2-4941-9e34-a6002581070b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.273129 Dec 16 14:42:37.392846 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 268/523] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:37 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:37.397544 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1366720425", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "networks": [{"uuid": "a86c2bfe-cd8a-4625-92b8-54f4b30e84fa"}]}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:37.450136 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-97395cc6-0618-44e9-a82c-51ec5d736b8b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:37.459467 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-97395cc6-0618-44e9-a82c-51ec5d736b8b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.259804 Dec 16 14:42:37.469120 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 256/524] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:37 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:37.469209 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.network.neutron [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] validate_networks() for [('a86c2bfe-cd8a-4625-92b8-54f4b30e84fa', None, None, None)] {{(pid=101914) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:42:37.469292 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a9e3db6f-c28f-4189-9fcb-b974fcaeb7d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:37.469292 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a9e3db6f-c28f-4189-9fcb-b974fcaeb7d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:37.474478 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a9e3db6f-c28f-4189-9fcb-b974fcaeb7d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:37.474927 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a9e3db6f-c28f-4189-9fcb-b974fcaeb7d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:37.475822 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a9e3db6f-c28f-4189-9fcb-b974fcaeb7d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:37.476264 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a9e3db6f-c28f-4189-9fcb-b974fcaeb7d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:37.848330 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-a9e3db6f-c28f-4189-9fcb-b974fcaeb7d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:37.857925 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-a9e3db6f-c28f-4189-9fcb-b974fcaeb7d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:37.859418 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-a9e3db6f-c28f-4189-9fcb-b974fcaeb7d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:37.860533 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a9e3db6f-c28f-4189-9fcb-b974fcaeb7d6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.399287 Dec 16 14:42:37.861298 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 257/525] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:37 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:38.023931 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Flavor limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:42:38.024364 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Image limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:42:38.024860 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Flavor pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:42:38.025268 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Image pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:42:38.025700 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:42:38.033913 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.034348 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.035170 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.035589 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.053371 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Getting quotas for project cd04f3d6f9ef4788bb01db0c11ba554f. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:42:38.057389 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Getting quotas for user cb0d5bf878154c6fa174db6389f2ea70 and project cd04f3d6f9ef4788bb01db0c11ba554f. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:42:38.068529 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Going to run 1 instances... {{(pid=101914) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:42:38.070874 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:42:38.113833 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-622d525d-0de6-4de0-8a94-aab9a8f6e33c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719753 Dec 16 14:42:38.114473 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 269/526] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:42:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:42:38.124326 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5f0aff3d-a21c-4a63-9729-ac5f9dce2385 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:38.124971 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5f0aff3d-a21c-4a63-9729-ac5f9dce2385 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:38.193315 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5f0aff3d-a21c-4a63-9729-ac5f9dce2385 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:38.206357 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5f0aff3d-a21c-4a63-9729-ac5f9dce2385 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1219 microversion: 2.1 time: 0.085535 Dec 16 14:42:38.207571 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 258/527] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:38 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:38.408661 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9ebd7955-40fa-42a0-925b-0c581bc59112 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:38.409400 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9ebd7955-40fa-42a0-925b-0c581bc59112 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:38.416908 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9ebd7955-40fa-42a0-925b-0c581bc59112 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.417416 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9ebd7955-40fa-42a0-925b-0c581bc59112 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.418178 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9ebd7955-40fa-42a0-925b-0c581bc59112 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.418604 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9ebd7955-40fa-42a0-925b-0c581bc59112 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.475963 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c060571e-1635-4abb-9308-f504223b320c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:38.476635 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c060571e-1635-4abb-9308-f504223b320c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:38.484464 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c060571e-1635-4abb-9308-f504223b320c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.485007 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c060571e-1635-4abb-9308-f504223b320c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.486370 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c060571e-1635-4abb-9308-f504223b320c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.486814 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c060571e-1635-4abb-9308-f504223b320c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.665132 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9ebd7955-40fa-42a0-925b-0c581bc59112 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:38.673738 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9ebd7955-40fa-42a0-925b-0c581bc59112 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.268596 Dec 16 14:42:38.674313 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 270/528] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:38 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:38.725906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c060571e-1635-4abb-9308-f504223b320c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:38.734072 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c060571e-1635-4abb-9308-f504223b320c tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.261855 Dec 16 14:42:38.734634 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 259/529] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:38 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:38.878968 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-21a5d732-0b1f-4e94-8a49-cab5e8f68886 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:38.879493 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-21a5d732-0b1f-4e94-8a49-cab5e8f68886 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:38.886771 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-21a5d732-0b1f-4e94-8a49-cab5e8f68886 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.887219 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-21a5d732-0b1f-4e94-8a49-cab5e8f68886 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:38.888001 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-21a5d732-0b1f-4e94-8a49-cab5e8f68886 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:38.888425 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-21a5d732-0b1f-4e94-8a49-cab5e8f68886 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.083874 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-21a5d732-0b1f-4e94-8a49-cab5e8f68886 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:39.092971 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-21a5d732-0b1f-4e94-8a49-cab5e8f68886 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:39.094488 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-21a5d732-0b1f-4e94-8a49-cab5e8f68886 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:39.096182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-21a5d732-0b1f-4e94-8a49-cab5e8f68886 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.221251 Dec 16 14:42:39.096735 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 271/530] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:38 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:39.223645 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7f68919d-320f-4fff-9e94-1831235720f5 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:39.224968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7f68919d-320f-4fff-9e94-1831235720f5 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:39.233159 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7f68919d-320f-4fff-9e94-1831235720f5 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.233916 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7f68919d-320f-4fff-9e94-1831235720f5 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.234976 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7f68919d-320f-4fff-9e94-1831235720f5 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.235480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7f68919d-320f-4fff-9e94-1831235720f5 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.350691 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7f68919d-320f-4fff-9e94-1831235720f5 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:39.359365 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7f68919d-320f-4fff-9e94-1831235720f5 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1223 microversion: 2.1 time: 0.139328 Dec 16 14:42:39.363739 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 260/531] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:39 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:39.690846 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-93900fe5-61a1-441a-8c7c-9b46c360f44c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:39.691513 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-93900fe5-61a1-441a-8c7c-9b46c360f44c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:39.698575 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-93900fe5-61a1-441a-8c7c-9b46c360f44c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.699014 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-93900fe5-61a1-441a-8c7c-9b46c360f44c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.699777 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-93900fe5-61a1-441a-8c7c-9b46c360f44c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.700200 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-93900fe5-61a1-441a-8c7c-9b46c360f44c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.751830 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1906d57a-318f-484a-b306-195dec4416f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:39.752356 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1906d57a-318f-484a-b306-195dec4416f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:39.759544 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1906d57a-318f-484a-b306-195dec4416f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.760000 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1906d57a-318f-484a-b306-195dec4416f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:39.760799 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1906d57a-318f-484a-b306-195dec4416f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:39.761265 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1906d57a-318f-484a-b306-195dec4416f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:40.062183 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-93900fe5-61a1-441a-8c7c-9b46c360f44c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:40.067760 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1906d57a-318f-484a-b306-195dec4416f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:40.071637 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-93900fe5-61a1-441a-8c7c-9b46c360f44c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.384910 Dec 16 14:42:40.072555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 272/532] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:39 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:40.085979 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1906d57a-318f-484a-b306-195dec4416f6 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.338384 Dec 16 14:42:40.086756 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 261/533] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:39 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:40.114197 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-884ccc5d-defb-440b-8944-7bfdb40aa2e3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:40.114804 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-884ccc5d-defb-440b-8944-7bfdb40aa2e3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:40.121990 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-884ccc5d-defb-440b-8944-7bfdb40aa2e3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:40.122442 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-884ccc5d-defb-440b-8944-7bfdb40aa2e3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:40.123245 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-884ccc5d-defb-440b-8944-7bfdb40aa2e3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:40.123681 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-884ccc5d-defb-440b-8944-7bfdb40aa2e3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:40.332340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-884ccc5d-defb-440b-8944-7bfdb40aa2e3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:40.341783 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-884ccc5d-defb-440b-8944-7bfdb40aa2e3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:40.343291 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-884ccc5d-defb-440b-8944-7bfdb40aa2e3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:40.344418 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-884ccc5d-defb-440b-8944-7bfdb40aa2e3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.234606 Dec 16 14:42:40.345089 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 273/534] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:40 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:42:40.376598 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e8541bad-50b7-465f-af0c-4888282f0c68 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:40.377231 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e8541bad-50b7-465f-af0c-4888282f0c68 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:40.384376 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8541bad-50b7-465f-af0c-4888282f0c68 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:40.384841 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8541bad-50b7-465f-af0c-4888282f0c68 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:40.385631 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8541bad-50b7-465f-af0c-4888282f0c68 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:40.386047 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8541bad-50b7-465f-af0c-4888282f0c68 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:40.512808 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e8541bad-50b7-465f-af0c-4888282f0c68 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:40.521861 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e8541bad-50b7-465f-af0c-4888282f0c68 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1277 microversion: 2.1 time: 0.149471 Dec 16 14:42:40.529107 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 262/535] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:40 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:41.088878 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c896694b-6580-403b-9c48-9de89eeb3389 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:41.090555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c896694b-6580-403b-9c48-9de89eeb3389 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:41.102463 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c896694b-6580-403b-9c48-9de89eeb3389 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.103478 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c896694b-6580-403b-9c48-9de89eeb3389 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.104542 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-eb5216df-07c8-465a-a3b1-0edff581848e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:41.104951 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c896694b-6580-403b-9c48-9de89eeb3389 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.105332 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-eb5216df-07c8-465a-a3b1-0edff581848e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:41.105784 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c896694b-6580-403b-9c48-9de89eeb3389 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.119465 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb5216df-07c8-465a-a3b1-0edff581848e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.120011 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb5216df-07c8-465a-a3b1-0edff581848e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.120984 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb5216df-07c8-465a-a3b1-0edff581848e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.125611 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb5216df-07c8-465a-a3b1-0edff581848e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.531634 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-eb5216df-07c8-465a-a3b1-0edff581848e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:41.553267 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-eb5216df-07c8-465a-a3b1-0edff581848e tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.452468 Dec 16 14:42:41.554426 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 263/536] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:41 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:41.555212 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c896694b-6580-403b-9c48-9de89eeb3389 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:41.568967 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-30ac550f-3685-492d-96f1-1cf44075533b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:41.570519 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-30ac550f-3685-492d-96f1-1cf44075533b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:41.570829 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c896694b-6580-403b-9c48-9de89eeb3389 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.484569 Dec 16 14:42:41.580603 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 274/537] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:41 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:41.580603 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-585f134a-7fe6-4e21-a83c-42047fcfe1a1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:41.580603 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-585f134a-7fe6-4e21-a83c-42047fcfe1a1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:41.586344 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-30ac550f-3685-492d-96f1-1cf44075533b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.587086 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-30ac550f-3685-492d-96f1-1cf44075533b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.588252 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-30ac550f-3685-492d-96f1-1cf44075533b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.588997 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-30ac550f-3685-492d-96f1-1cf44075533b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.597685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-585f134a-7fe6-4e21-a83c-42047fcfe1a1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.598983 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-585f134a-7fe6-4e21-a83c-42047fcfe1a1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.599846 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-585f134a-7fe6-4e21-a83c-42047fcfe1a1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:41.601517 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-585f134a-7fe6-4e21-a83c-42047fcfe1a1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:41.941718 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-30ac550f-3685-492d-96f1-1cf44075533b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:41.946741 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-585f134a-7fe6-4e21-a83c-42047fcfe1a1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:41.973050 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-585f134a-7fe6-4e21-a83c-42047fcfe1a1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1319 microversion: 2.1 time: 0.399229 Dec 16 14:42:41.982169 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 275/538] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:41 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:41.982354 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-30ac550f-3685-492d-96f1-1cf44075533b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:41.982354 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-30ac550f-3685-492d-96f1-1cf44075533b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:41.982354 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-30ac550f-3685-492d-96f1-1cf44075533b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.422789 Dec 16 14:42:41.989920 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 264/539] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:41 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:42.476655 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-90f0455c-86cd-467a-ae6b-9ebebf7db47a req-8eae1efb-a3e8-44a6-b831-3f9b1f3473b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f91e2ef5-e95c-4515-a357-42a3a3902b79", "tag": "4ea72ead-9020-47dd-b54b-ae7b67b61c47"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:42.479308 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:42.479308 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:42:42.494002 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-90f0455c-86cd-467a-ae6b-9ebebf7db47a req-8eae1efb-a3e8-44a6-b831-3f9b1f3473b4 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:42.494943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-90f0455c-86cd-467a-ae6b-9ebebf7db47a req-8eae1efb-a3e8-44a6-b831-3f9b1f3473b4 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:42.518155 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-90f0455c-86cd-467a-ae6b-9ebebf7db47a req-8eae1efb-a3e8-44a6-b831-3f9b1f3473b4 service nova] Creating event network-changed:4ea72ead-9020-47dd-b54b-ae7b67b61c47 for instance f91e2ef5-e95c-4515-a357-42a3a3902b79 on hv-cinder-82189 Dec 16 14:42:42.527034 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-90f0455c-86cd-467a-ae6b-9ebebf7db47a req-8eae1efb-a3e8-44a6-b831-3f9b1f3473b4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054477 Dec 16 14:42:42.530719 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 276/540] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:42.572190 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-dac3268c-be0f-4ab7-b1c9-0443b585d692 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:42.573684 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-dac3268c-be0f-4ab7-b1c9-0443b585d692 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:42.589425 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e265b698-1ed8-4e9b-8792-f9a91b507057 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:42.590570 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e265b698-1ed8-4e9b-8792-f9a91b507057 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:42.596937 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dac3268c-be0f-4ab7-b1c9-0443b585d692 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:42.597398 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dac3268c-be0f-4ab7-b1c9-0443b585d692 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:42.598176 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dac3268c-be0f-4ab7-b1c9-0443b585d692 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:42.598611 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dac3268c-be0f-4ab7-b1c9-0443b585d692 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:42.607626 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e265b698-1ed8-4e9b-8792-f9a91b507057 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:42.612934 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e265b698-1ed8-4e9b-8792-f9a91b507057 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:42.614386 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e265b698-1ed8-4e9b-8792-f9a91b507057 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:42.615920 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e265b698-1ed8-4e9b-8792-f9a91b507057 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:42.992760 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e265b698-1ed8-4e9b-8792-f9a91b507057 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:43.007903 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e265b698-1ed8-4e9b-8792-f9a91b507057 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.423044 Dec 16 14:42:43.009562 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 277/541] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:42 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:43.018411 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-431d3362-521d-4481-9638-a9803399b866 req-268a70e5-c008-4912-84f1-8b3982e0e523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e7a3c6-dc99-4927-83c2-dd8ba87239b2", "name": "network-vif-plugged", "status": "completed", "tag": "3086416d-8f44-45e7-a877-073ca8530605"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:43.023209 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:43.023209 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:42:43.050658 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-431d3362-521d-4481-9638-a9803399b866 req-268a70e5-c008-4912-84f1-8b3982e0e523 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:43.051281 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-431d3362-521d-4481-9638-a9803399b866 req-268a70e5-c008-4912-84f1-8b3982e0e523 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.073656 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-dac3268c-be0f-4ab7-b1c9-0443b585d692 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:43.081577 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-431d3362-521d-4481-9638-a9803399b866 req-268a70e5-c008-4912-84f1-8b3982e0e523 service nova] Creating event network-vif-plugged:3086416d-8f44-45e7-a877-073ca8530605 for instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 on hv-cinder-82189 Dec 16 14:42:43.086395 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-dac3268c-be0f-4ab7-b1c9-0443b585d692 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.519840 Dec 16 14:42:43.097347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 265/542] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:42 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:43.099966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-431d3362-521d-4481-9638-a9803399b866 req-268a70e5-c008-4912-84f1-8b3982e0e523 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089044 Dec 16 14:42:43.103677 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7ac66648-24b1-44e2-b3b7-313d36c9775e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:43.104399 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 278/543] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:43.104966 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7ac66648-24b1-44e2-b3b7-313d36c9775e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:43.117709 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bc4739ce-7967-4303-92f3-fa0ef8683fc1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:43.118795 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bc4739ce-7967-4303-92f3-fa0ef8683fc1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:43.119295 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7ac66648-24b1-44e2-b3b7-313d36c9775e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:43.119752 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7ac66648-24b1-44e2-b3b7-313d36c9775e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.120554 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7ac66648-24b1-44e2-b3b7-313d36c9775e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:43.121024 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7ac66648-24b1-44e2-b3b7-313d36c9775e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.131729 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc4739ce-7967-4303-92f3-fa0ef8683fc1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:43.132458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc4739ce-7967-4303-92f3-fa0ef8683fc1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.133743 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc4739ce-7967-4303-92f3-fa0ef8683fc1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:43.134423 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc4739ce-7967-4303-92f3-fa0ef8683fc1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:43.475761 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7ac66648-24b1-44e2-b3b7-313d36c9775e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:43.475952 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bc4739ce-7967-4303-92f3-fa0ef8683fc1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:43.491651 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bc4739ce-7967-4303-92f3-fa0ef8683fc1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:43.493954 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bc4739ce-7967-4303-92f3-fa0ef8683fc1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:43.495272 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bc4739ce-7967-4303-92f3-fa0ef8683fc1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.386402 Dec 16 14:42:43.495819 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 279/544] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:43 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:43.496319 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7ac66648-24b1-44e2-b3b7-313d36c9775e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1319 microversion: 2.1 time: 0.396684 Dec 16 14:42:43.506277 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 266/545] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:43 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:44.024330 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3b5ad020-e6a6-4bd8-9ea7-3789e06d4796 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:44.024867 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3b5ad020-e6a6-4bd8-9ea7-3789e06d4796 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:44.033543 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b5ad020-e6a6-4bd8-9ea7-3789e06d4796 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.035306 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b5ad020-e6a6-4bd8-9ea7-3789e06d4796 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.036184 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b5ad020-e6a6-4bd8-9ea7-3789e06d4796 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.036704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b5ad020-e6a6-4bd8-9ea7-3789e06d4796 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.103208 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-996f53ae-7b78-4010-9ae6-5efb5b4ad083 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:44.104009 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-996f53ae-7b78-4010-9ae6-5efb5b4ad083 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:44.111828 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-996f53ae-7b78-4010-9ae6-5efb5b4ad083 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.112277 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-996f53ae-7b78-4010-9ae6-5efb5b4ad083 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.113094 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-996f53ae-7b78-4010-9ae6-5efb5b4ad083 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.113533 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-996f53ae-7b78-4010-9ae6-5efb5b4ad083 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.326486 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3b5ad020-e6a6-4bd8-9ea7-3789e06d4796 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:44.336000 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3b5ad020-e6a6-4bd8-9ea7-3789e06d4796 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.315548 Dec 16 14:42:44.336591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 280/546] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:44 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:44.404171 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-996f53ae-7b78-4010-9ae6-5efb5b4ad083 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:44.413565 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-996f53ae-7b78-4010-9ae6-5efb5b4ad083 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.313886 Dec 16 14:42:44.414425 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 267/547] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:44 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:44.514143 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-be27d03c-1513-43f0-9550-472f6db09c05 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:44.515750 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-be27d03c-1513-43f0-9550-472f6db09c05 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:44.521712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-972f18f7-54af-40a4-b990-830d3a7c0f0b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:44.522812 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-972f18f7-54af-40a4-b990-830d3a7c0f0b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:44.537069 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-be27d03c-1513-43f0-9550-472f6db09c05 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.538384 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-972f18f7-54af-40a4-b990-830d3a7c0f0b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.538911 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-972f18f7-54af-40a4-b990-830d3a7c0f0b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.539761 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-972f18f7-54af-40a4-b990-830d3a7c0f0b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.540339 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-be27d03c-1513-43f0-9550-472f6db09c05 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.540900 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-972f18f7-54af-40a4-b990-830d3a7c0f0b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.542979 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-be27d03c-1513-43f0-9550-472f6db09c05 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:44.548693 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-be27d03c-1513-43f0-9550-472f6db09c05 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:44.811113 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-972f18f7-54af-40a4-b990-830d3a7c0f0b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:44.822540 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-972f18f7-54af-40a4-b990-830d3a7c0f0b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:44.824273 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-972f18f7-54af-40a4-b990-830d3a7c0f0b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:44.825963 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-972f18f7-54af-40a4-b990-830d3a7c0f0b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.307999 Dec 16 14:42:44.827326 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 268/548] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:44 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:45.064173 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-be27d03c-1513-43f0-9550-472f6db09c05 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:45.073215 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-be27d03c-1513-43f0-9550-472f6db09c05 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1319 microversion: 2.1 time: 0.562794 Dec 16 14:42:45.073801 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 281/549] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:44 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1319 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:45.355385 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fa4bcebc-3e00-4ef5-963c-6ab34ff8f4c8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:45.357149 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fa4bcebc-3e00-4ef5-963c-6ab34ff8f4c8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:45.375841 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa4bcebc-3e00-4ef5-963c-6ab34ff8f4c8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:45.376631 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa4bcebc-3e00-4ef5-963c-6ab34ff8f4c8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:45.377697 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa4bcebc-3e00-4ef5-963c-6ab34ff8f4c8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:45.378541 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa4bcebc-3e00-4ef5-963c-6ab34ff8f4c8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:45.430492 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b8600775-fd18-4466-8eaa-ed02cd0efb4b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:45.431117 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b8600775-fd18-4466-8eaa-ed02cd0efb4b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:45.446304 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b8600775-fd18-4466-8eaa-ed02cd0efb4b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:45.446754 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b8600775-fd18-4466-8eaa-ed02cd0efb4b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:45.447560 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b8600775-fd18-4466-8eaa-ed02cd0efb4b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:45.447995 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b8600775-fd18-4466-8eaa-ed02cd0efb4b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:45.984488 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b8600775-fd18-4466-8eaa-ed02cd0efb4b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:45.989950 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fa4bcebc-3e00-4ef5-963c-6ab34ff8f4c8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:45.998946 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fa4bcebc-3e00-4ef5-963c-6ab34ff8f4c8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.647511 Dec 16 14:42:46.001009 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b8600775-fd18-4466-8eaa-ed02cd0efb4b tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1522 microversion: 2.1 time: 0.568398 Dec 16 14:42:46.001716 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 269/550] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:45 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:46.006417 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-13cdee2c-7d0f-427e-bc27-95edbac7abe0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:46.007455 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-13cdee2c-7d0f-427e-bc27-95edbac7abe0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:46.017154 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 282/551] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:45 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:46.017938 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13cdee2c-7d0f-427e-bc27-95edbac7abe0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.019558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13cdee2c-7d0f-427e-bc27-95edbac7abe0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.020624 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13cdee2c-7d0f-427e-bc27-95edbac7abe0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.021273 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13cdee2c-7d0f-427e-bc27-95edbac7abe0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.092210 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1e9700a3-5c3a-4cfc-8a41-70dd040090ea tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:46.093795 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1e9700a3-5c3a-4cfc-8a41-70dd040090ea tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:46.120661 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1e9700a3-5c3a-4cfc-8a41-70dd040090ea tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.122389 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1e9700a3-5c3a-4cfc-8a41-70dd040090ea tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.123229 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1e9700a3-5c3a-4cfc-8a41-70dd040090ea tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.123674 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1e9700a3-5c3a-4cfc-8a41-70dd040090ea tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.383321 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-13cdee2c-7d0f-427e-bc27-95edbac7abe0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:46.399956 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-13cdee2c-7d0f-427e-bc27-95edbac7abe0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:46.402628 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-13cdee2c-7d0f-427e-bc27-95edbac7abe0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:46.413379 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-13cdee2c-7d0f-427e-bc27-95edbac7abe0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1809 microversion: 2.20 time: 0.404174 Dec 16 14:42:46.415042 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 270/552] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:46 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1809 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:46.519167 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1e9700a3-5c3a-4cfc-8a41-70dd040090ea tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:46.534891 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1e9700a3-5c3a-4cfc-8a41-70dd040090ea tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1319 microversion: 2.1 time: 0.448856 Dec 16 14:42:46.536939 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 283/553] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:46 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:46.701273 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-471398f4-e0fb-4fe5-b59e-5e8201a94a6c req-d9fc5905-57cc-4a6b-97b7-269ebc097bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afaa3d8-bcc9-4473-807c-ea33c70e2d05", "name": "network-vif-deleted", "tag": "33fce9f6-5ac0-4aa0-996a-ade01b65bda3"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:46.703307 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:46.703307 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:42:46.715536 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-471398f4-e0fb-4fe5-b59e-5e8201a94a6c req-d9fc5905-57cc-4a6b-97b7-269ebc097bef service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:46.720675 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-471398f4-e0fb-4fe5-b59e-5e8201a94a6c req-d9fc5905-57cc-4a6b-97b7-269ebc097bef service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:46.761495 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-471398f4-e0fb-4fe5-b59e-5e8201a94a6c req-d9fc5905-57cc-4a6b-97b7-269ebc097bef service nova] Creating event network-vif-deleted:33fce9f6-5ac0-4aa0-996a-ade01b65bda3 for instance 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 on hv-cinder-82189 Dec 16 14:42:46.781438 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-471398f4-e0fb-4fe5-b59e-5e8201a94a6c req-d9fc5905-57cc-4a6b-97b7-269ebc097bef service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083344 Dec 16 14:42:46.784444 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 271/554] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:47.018093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8571c608-5be0-4c24-ab67-1ee17e181a7a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:47.019450 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8571c608-5be0-4c24-ab67-1ee17e181a7a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:47.023163 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:47.023859 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:47.036185 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8571c608-5be0-4c24-ab67-1ee17e181a7a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.036602 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8571c608-5be0-4c24-ab67-1ee17e181a7a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.037671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8571c608-5be0-4c24-ab67-1ee17e181a7a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.038267 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8571c608-5be0-4c24-ab67-1ee17e181a7a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.038892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.039357 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.040151 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.040604 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.122757 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.123424 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.124036 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lazy-loading 'fault' on Instance uuid 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:42:47.261638 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4166133ac04844d491662feab2bd2d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceb0da71791f4f9889daab33c73ac572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:47.273034 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-cce80070-b381-48eb-ac0a-92d63ca5b796 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 200 len: 1312 microversion: 2.1 time: 0.254011 Dec 16 14:42:47.294438 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 272/555] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:47 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:47.301007 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-4ffdcea6-938a-41a2-b1f8-ee2c13886cbf req-aadf0ba6-dbaa-4150-926b-daabc9ee9ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bc07c-edbd-4753-8055-d84a33315464", "name": "network-vif-plugged", "status": "completed", "tag": "526505bf-e823-46fa-a1a2-6e5aff27c04f"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:47.302625 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:47.302625 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:42:47.313006 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-4ffdcea6-938a-41a2-b1f8-ee2c13886cbf req-aadf0ba6-dbaa-4150-926b-daabc9ee9ab7 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.313711 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-4ffdcea6-938a-41a2-b1f8-ee2c13886cbf req-aadf0ba6-dbaa-4150-926b-daabc9ee9ab7 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.332234 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-4ffdcea6-938a-41a2-b1f8-ee2c13886cbf req-aadf0ba6-dbaa-4150-926b-daabc9ee9ab7 service nova] Creating event network-vif-plugged:526505bf-e823-46fa-a1a2-6e5aff27c04f for instance 852bc07c-edbd-4753-8055-d84a33315464 on hv-cinder-82189 Dec 16 14:42:47.339120 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-4ffdcea6-938a-41a2-b1f8-ee2c13886cbf req-aadf0ba6-dbaa-4150-926b-daabc9ee9ab7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042625 Dec 16 14:42:47.339997 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 273/556] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:47.412192 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8571c608-5be0-4c24-ab67-1ee17e181a7a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:47.423074 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8571c608-5be0-4c24-ab67-1ee17e181a7a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.408723 Dec 16 14:42:47.423573 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 284/557] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:47 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:47.437664 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ecfb0b4f-812d-4bc1-be60-d2dab299f034 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:47.439601 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ecfb0b4f-812d-4bc1-be60-d2dab299f034 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:47.459106 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ecfb0b4f-812d-4bc1-be60-d2dab299f034 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.460355 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ecfb0b4f-812d-4bc1-be60-d2dab299f034 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.461440 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ecfb0b4f-812d-4bc1-be60-d2dab299f034 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.462074 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ecfb0b4f-812d-4bc1-be60-d2dab299f034 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.551642 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-60926181-79d0-42fa-908e-533166b02cc6 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:47.552497 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-60926181-79d0-42fa-908e-533166b02cc6 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:47.566896 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-60926181-79d0-42fa-908e-533166b02cc6 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.567686 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-60926181-79d0-42fa-908e-533166b02cc6 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.569881 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-60926181-79d0-42fa-908e-533166b02cc6 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:47.570586 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-60926181-79d0-42fa-908e-533166b02cc6 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:47.850162 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ecfb0b4f-812d-4bc1-be60-d2dab299f034 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:47.885780 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ecfb0b4f-812d-4bc1-be60-d2dab299f034 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:47.888081 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ecfb0b4f-812d-4bc1-be60-d2dab299f034 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:47.894263 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ecfb0b4f-812d-4bc1-be60-d2dab299f034 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1796 microversion: 2.20 time: 0.460713 Dec 16 14:42:47.895566 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 274/558] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:42:47 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1796 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:42:48.033080 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-60926181-79d0-42fa-908e-533166b02cc6 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:48.071065 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-60926181-79d0-42fa-908e-533166b02cc6 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1319 microversion: 2.1 time: 0.522739 Dec 16 14:42:48.071899 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 285/559] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:47 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:48.289849 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8a5135e2-6ac7-4e5b-b264-06bc0c6ccac5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:48.290624 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8a5135e2-6ac7-4e5b-b264-06bc0c6ccac5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] [instance: 3afaa3d8-bcc9-4473-807c-ea33c70e2d05] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:48.299220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a5135e2-6ac7-4e5b-b264-06bc0c6ccac5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:48.299801 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a5135e2-6ac7-4e5b-b264-06bc0c6ccac5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:48.300757 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a5135e2-6ac7-4e5b-b264-06bc0c6ccac5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:48.301319 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a5135e2-6ac7-4e5b-b264-06bc0c6ccac5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:48.364483 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-8a5135e2-6ac7-4e5b-b264-06bc0c6ccac5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] HTTP exception thrown: Instance 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 could not be found. Dec 16 14:42:48.365300 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8a5135e2-6ac7-4e5b-b264-06bc0c6ccac5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] Returning 404 to user: Instance 3afaa3d8-bcc9-4473-807c-ea33c70e2d05 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:42:48.366335 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8a5135e2-6ac7-4e5b-b264-06bc0c6ccac5 tempest-ServerRescueNegativeTestJSON-1864195994 tempest-ServerRescueNegativeTestJSON-1864195994-project] 10.222.0.64 "GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05" status: 404 len: 111 microversion: 2.1 time: 0.080267 Dec 16 14:42:48.371269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 275/560] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:48 2021] GET /compute/v2.1/servers/3afaa3d8-bcc9-4473-807c-ea33c70e2d05 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:42:48.439960 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d992b8e8-7645-4495-b8ad-e0df00b35884 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:48.440574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d992b8e8-7645-4495-b8ad-e0df00b35884 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:48.458804 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d992b8e8-7645-4495-b8ad-e0df00b35884 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:48.459181 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d992b8e8-7645-4495-b8ad-e0df00b35884 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:48.459999 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d992b8e8-7645-4495-b8ad-e0df00b35884 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:48.460331 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d992b8e8-7645-4495-b8ad-e0df00b35884 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:48.724841 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d992b8e8-7645-4495-b8ad-e0df00b35884 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:48.735369 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d992b8e8-7645-4495-b8ad-e0df00b35884 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1318 microversion: 2.1 time: 0.299059 Dec 16 14:42:48.736637 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 286/561] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:48 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:49.088539 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0eef4570-1342-457e-bba5-d527529a46de tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:49.089924 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0eef4570-1342-457e-bba5-d527529a46de tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:49.100036 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0eef4570-1342-457e-bba5-d527529a46de tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.105157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0eef4570-1342-457e-bba5-d527529a46de tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.106294 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0eef4570-1342-457e-bba5-d527529a46de tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.110489 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0eef4570-1342-457e-bba5-d527529a46de tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.453809 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-0eef4570-1342-457e-bba5-d527529a46de tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:49.465742 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0eef4570-1342-457e-bba5-d527529a46de tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1319 microversion: 2.1 time: 0.380747 Dec 16 14:42:49.466688 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 276/562] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:49 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:49.753618 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2b389c83-2b7c-4b21-82ac-7685c0d91ad5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:49.755023 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2b389c83-2b7c-4b21-82ac-7685c0d91ad5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:49.769993 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b389c83-2b7c-4b21-82ac-7685c0d91ad5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.770839 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b389c83-2b7c-4b21-82ac-7685c0d91ad5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:49.772374 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b389c83-2b7c-4b21-82ac-7685c0d91ad5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:49.773519 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b389c83-2b7c-4b21-82ac-7685c0d91ad5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:50.069410 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2b389c83-2b7c-4b21-82ac-7685c0d91ad5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:50.083842 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2b389c83-2b7c-4b21-82ac-7685c0d91ad5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1508 microversion: 2.1 time: 0.334858 Dec 16 14:42:50.109425 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 287/563] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:49 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:50.488610 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5dc5f098-04ed-492c-8e3d-74c2a5570c70 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:50.490626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5dc5f098-04ed-492c-8e3d-74c2a5570c70 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:50.518722 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5dc5f098-04ed-492c-8e3d-74c2a5570c70 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:50.524604 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5dc5f098-04ed-492c-8e3d-74c2a5570c70 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:50.528171 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5dc5f098-04ed-492c-8e3d-74c2a5570c70 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:50.530437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5dc5f098-04ed-492c-8e3d-74c2a5570c70 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:50.763985 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-f4c763aa-3f7e-49ff-8bb2-8112ad43b775 req-5696cc97-4248-4de9-939e-2cc45c15a077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91e2ef5-e95c-4515-a357-42a3a3902b79", "name": "network-vif-plugged", "status": "completed", "tag": "4ea72ead-9020-47dd-b54b-ae7b67b61c47"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:50.766565 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:42:50.766565 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:42:50.797843 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-f4c763aa-3f7e-49ff-8bb2-8112ad43b775 req-5696cc97-4248-4de9-939e-2cc45c15a077 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:50.807499 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-f4c763aa-3f7e-49ff-8bb2-8112ad43b775 req-5696cc97-4248-4de9-939e-2cc45c15a077 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:50.883929 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-f4c763aa-3f7e-49ff-8bb2-8112ad43b775 req-5696cc97-4248-4de9-939e-2cc45c15a077 service nova] Creating event network-vif-plugged:4ea72ead-9020-47dd-b54b-ae7b67b61c47 for instance f91e2ef5-e95c-4515-a357-42a3a3902b79 on hv-cinder-82189 Dec 16 14:42:50.898767 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-f4c763aa-3f7e-49ff-8bb2-8112ad43b775 req-5696cc97-4248-4de9-939e-2cc45c15a077 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139009 Dec 16 14:42:50.901869 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 288/564] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:42:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:51.055092 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5dc5f098-04ed-492c-8e3d-74c2a5570c70 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:51.064816 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5dc5f098-04ed-492c-8e3d-74c2a5570c70 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1319 microversion: 2.1 time: 0.584215 Dec 16 14:42:51.065505 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 277/565] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:50 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1319 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:42:52.086106 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-863fb545-070c-43a5-b637-c41b5d478787 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:52.089109 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-863fb545-070c-43a5-b637-c41b5d478787 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:52.105391 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-863fb545-070c-43a5-b637-c41b5d478787 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:52.105840 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-863fb545-070c-43a5-b637-c41b5d478787 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:52.113194 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-863fb545-070c-43a5-b637-c41b5d478787 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:52.113764 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-863fb545-070c-43a5-b637-c41b5d478787 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:52.162353 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1e556ce5-f356-425a-9f31-7cb0d402a3fe tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d21f9b3-f894-4201-8f3b-1a420e2c3310"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:52.164150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1e556ce5-f356-425a-9f31-7cb0d402a3fe tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:52.183064 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1e556ce5-f356-425a-9f31-7cb0d402a3fe tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:52.185623 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1e556ce5-f356-425a-9f31-7cb0d402a3fe tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:52.188620 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1e556ce5-f356-425a-9f31-7cb0d402a3fe tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:52.189313 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1e556ce5-f356-425a-9f31-7cb0d402a3fe tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:52.832452 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-863fb545-070c-43a5-b637-c41b5d478787 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:52.844391 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-863fb545-070c-43a5-b637-c41b5d478787 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1319 microversion: 2.1 time: 0.763935 Dec 16 14:42:52.856673 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 289/566] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:52 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1319 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:52.956640 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1e556ce5-f356-425a-9f31-7cb0d402a3fe tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "POST /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800066 Dec 16 14:42:52.958366 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 278/567] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:42:52 2021] POST /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:53.652243 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:42:53.656037 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: Thu Dec 16 14:42:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 14:42:53.864717 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-128d72d7-b75b-4b7c-854c-a36f7fa98bee tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:53.866395 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-128d72d7-b75b-4b7c-854c-a36f7fa98bee tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:53.880610 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-128d72d7-b75b-4b7c-854c-a36f7fa98bee tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:53.881539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-128d72d7-b75b-4b7c-854c-a36f7fa98bee tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:53.883891 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-128d72d7-b75b-4b7c-854c-a36f7fa98bee tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:53.885253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-128d72d7-b75b-4b7c-854c-a36f7fa98bee tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:54.373545 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-128d72d7-b75b-4b7c-854c-a36f7fa98bee tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:42:54.384714 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-128d72d7-b75b-4b7c-854c-a36f7fa98bee tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1508 microversion: 2.1 time: 0.526674 Dec 16 14:42:54.385893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 290/568] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:42:53 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1508 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:42:54.417964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ea264c8e-40c3-4b4c-9637-7f35606123e1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2931498-43ea-434f-b5bb-8b2c29ecdf79", "device": "/dev/sdb"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:54.422087 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ea264c8e-40c3-4b4c-9637-7f35606123e1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:42:54.438008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ea264c8e-40c3-4b4c-9637-7f35606123e1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:54.439152 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ea264c8e-40c3-4b4c-9637-7f35606123e1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:54.440560 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ea264c8e-40c3-4b4c-9637-7f35606123e1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:42:54.441374 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ea264c8e-40c3-4b4c-9637-7f35606123e1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:42:55.065901 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ea264c8e-40c3-4b4c-9637-7f35606123e1 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "POST /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.664122 Dec 16 14:42:55.066156 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 279/569] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:42:54 2021] POST /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:57.125388 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-eae413cf-fa6e-4984-b742-18ce90630ab7 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Action: 'create', calling method: .version_select at 0x7f3c2c442ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1368416085"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:57.655229 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-eae413cf-fa6e-4984-b742-18ce90630ab7 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.658312 Dec 16 14:42:57.656437 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 291/570] 10.222.0.64 () {60 vars in 1154 bytes} [Thu Dec 16 14:42:56 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 660 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 16 14:42:57.668027 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b26b40e1-9ff8-463b-9e55-4f657b33a89a tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2cd9b040>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:57.944937 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b26b40e1-9ff8-463b-9e55-4f657b33a89a tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18" status: 200 len: 345 microversion: 2.1 time: 0.281327 Dec 16 14:42:57.945505 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 280/571] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:42:57 2021] GET /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18 => generated 345 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:58.958347 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0f56adc5-d173-43ac-ad0b-8881bdd498b7 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2c384af0>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:59.058346 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0f56adc5-d173-43ac-ad0b-8881bdd498b7 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18" status: 200 len: 346 microversion: 2.1 time: 0.103684 Dec 16 14:42:59.058908 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 292/572] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:42:58 2021] GET /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18 => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:59.070558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2e97e4fd-73bf-4e28-b660-eeb9cbe7dd2e tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Action: 'create', calling method: .version_select at 0x7f3c2cd9b430>, body: {"snapshot": {"volume_id": "265c4a9f-a98c-4eae-930c-56d31096ff18", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1486266479"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:42:59.374016 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2e97e4fd-73bf-4e28-b660-eeb9cbe7dd2e tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.307081 Dec 16 14:42:59.374597 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 281/573] 10.222.0.64 () {60 vars in 1161 bytes} [Thu Dec 16 14:42:59 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:42:59.384627 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-09180098-450b-474d-b862-b57ccb6375ad tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2c675280>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:59.433657 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-09180098-450b-474d-b862-b57ccb6375ad tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253" status: 200 len: 287 microversion: 2.1 time: 0.052328 Dec 16 14:42:59.435216 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 293/574] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Dec 16 14:42:59 2021] GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:59.444987 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9fdbb4e3-0776-45e4-9b7b-16540d7d7a0e tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2c255280>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:59.495612 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9fdbb4e3-0776-45e4-9b7b-16540d7d7a0e tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.054410 Dec 16 14:42:59.496440 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 282/575] 10.222.0.64 () {58 vars in 1139 bytes} [Thu Dec 16 14:42:59 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:42:59.506899 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-db9af95c-f448-4f3e-ad20-d34b74b14c5f tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2c675160>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:42:59.560344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-db9af95c-f448-4f3e-ad20-d34b74b14c5f tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253" status: 200 len: 287 microversion: 2.1 time: 0.057190 Dec 16 14:42:59.564549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 294/576] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Dec 16 14:42:59 2021] GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:00.572555 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-459803e9-a380-4e3b-9093-e9cb82cab148 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2cd9bca0>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:00.614465 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-459803e9-a380-4e3b-9093-e9cb82cab148 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253" status: 200 len: 287 microversion: 2.1 time: 0.045978 Dec 16 14:43:00.615022 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 283/577] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Dec 16 14:43:00 2021] GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:01.626016 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5a8051ed-36bf-42b8-9d58-641aba4828f0 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2c384af0>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:01.670496 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5a8051ed-36bf-42b8-9d58-641aba4828f0 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253" status: 200 len: 287 microversion: 2.1 time: 0.048107 Dec 16 14:43:01.671047 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 295/578] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Dec 16 14:43:01 2021] GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:43:02.682193 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f864bacb-7be9-449e-ad65-cd45e236c55a tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2cdcfa60>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:02.725371 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f864bacb-7be9-449e-ad65-cd45e236c55a tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253" status: 200 len: 287 microversion: 2.1 time: 0.046849 Dec 16 14:43:02.725939 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 284/579] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Dec 16 14:43:02 2021] GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:03.708996 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7f433085-ad68-45e6-841d-4a858e6b5f78 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:03.709634 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7f433085-ad68-45e6-841d-4a858e6b5f78 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:03.717589 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f433085-ad68-45e6-841d-4a858e6b5f78 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:03.718393 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f433085-ad68-45e6-841d-4a858e6b5f78 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:03.719237 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f433085-ad68-45e6-841d-4a858e6b5f78 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:03.719870 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f433085-ad68-45e6-841d-4a858e6b5f78 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:03.737010 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b969dcac-cc31-4ede-b757-7491e50747bd tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2cd9b4c0>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:03.785096 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b969dcac-cc31-4ede-b757-7491e50747bd tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253" status: 200 len: 288 microversion: 2.1 time: 0.052524 Dec 16 14:43:03.785665 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 285/580] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Dec 16 14:43:03 2021] GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253 => generated 288 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:03.797257 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6bc0daee-096b-4927-9144-4245e5c6bca5 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2d7cdc10>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:03.948003 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-7f433085-ad68-45e6-841d-4a858e6b5f78 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lazy-loading 'services' on Instance uuid 852bc07c-edbd-4753-8055-d84a33315464 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:43:04.048429 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6bc0daee-096b-4927-9144-4245e5c6bca5 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253" status: 202 len: 0 microversion: 2.1 time: 0.256349 Dec 16 14:43:04.052656 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 286/581] 10.222.0.64 () {58 vars in 1253 bytes} [Thu Dec 16 14:43:03 2021] DELETE /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:43:04.057712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b06df156-ac3d-44cb-8ea8-e94d5c911119 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2c4d3820>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:04.108479 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b06df156-ac3d-44cb-8ea8-e94d5c911119 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253" status: 200 len: 287 microversion: 2.1 time: 0.054556 Dec 16 14:43:04.109705 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 287/582] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Dec 16 14:43:04 2021] GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:04.120518 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7f433085-ad68-45e6-841d-4a858e6b5f78 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "DELETE /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments/5d21f9b3-f894-4201-8f3b-1a420e2c3310" status: 202 len: 0 microversion: 2.1 time: 0.414964 Dec 16 14:43:04.121185 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 296/583] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:43:03 2021] DELETE /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments/5d21f9b3-f894-4201-8f3b-1a420e2c3310 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:43:04.131879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-65d8478e-092d-49f7-83a3-d972b39f3517 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:04.133137 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-65d8478e-092d-49f7-83a3-d972b39f3517 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:04.143395 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65d8478e-092d-49f7-83a3-d972b39f3517 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:04.144967 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65d8478e-092d-49f7-83a3-d972b39f3517 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:04.145886 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65d8478e-092d-49f7-83a3-d972b39f3517 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:04.146838 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65d8478e-092d-49f7-83a3-d972b39f3517 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:04.218744 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-65d8478e-092d-49f7-83a3-d972b39f3517 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091690 Dec 16 14:43:04.219381 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 288/584] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:04 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:05.121364 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c07361ac-780f-496a-951a-8845152135e1 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2de7f9d0>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:05.163189 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-c07361ac-780f-496a-951a-8845152135e1 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] HTTP exception thrown: Snapshot dcee59d9-4de9-460f-a62b-10b74067a253 could not be found. Dec 16 14:43:05.163968 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c07361ac-780f-496a-951a-8845152135e1 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Returning 404 to user: Snapshot dcee59d9-4de9-460f-a62b-10b74067a253 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:05.165053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c07361ac-780f-496a-951a-8845152135e1 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253" status: 404 len: 111 microversion: 2.1 time: 0.047910 Dec 16 14:43:05.165663 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 297/585] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Dec 16 14:43:05 2021] GET /compute/v2.1/os-snapshots/dcee59d9-4de9-460f-a62b-10b74067a253 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:05.173862 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fd7072db-e5d9-4316-9521-5f1638df7496 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2c255b80>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:05.229941 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e8d95b82-3304-4ad1-951b-8a7ae1d4f9e5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:05.231611 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e8d95b82-3304-4ad1-951b-8a7ae1d4f9e5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:05.243744 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e8d95b82-3304-4ad1-951b-8a7ae1d4f9e5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:05.244285 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e8d95b82-3304-4ad1-951b-8a7ae1d4f9e5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:05.245133 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e8d95b82-3304-4ad1-951b-8a7ae1d4f9e5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:05.245578 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e8d95b82-3304-4ad1-951b-8a7ae1d4f9e5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:05.273129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fd7072db-e5d9-4316-9521-5f1638df7496 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18" status: 202 len: 0 microversion: 2.1 time: 0.102907 Dec 16 14:43:05.273712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 289/586] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Dec 16 14:43:05 2021] DELETE /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:43:05.286687 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e2cebc89-b2f4-4cec-acbc-6c233c52cf90 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2cd9b790>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:05.320406 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e8d95b82-3304-4ad1-951b-8a7ae1d4f9e5 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094028 Dec 16 14:43:05.321443 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 298/587] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:05 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:43:05.384550 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e2cebc89-b2f4-4cec-acbc-6c233c52cf90 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18" status: 200 len: 345 microversion: 2.1 time: 0.105024 Dec 16 14:43:05.385296 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 290/588] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:43:05 2021] GET /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18 => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:43:06.332184 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4c2d8b31-adc2-46c8-8549-be400f504f80 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:06.333616 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4c2d8b31-adc2-46c8-8549-be400f504f80 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:06.342294 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c2d8b31-adc2-46c8-8549-be400f504f80 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:06.342843 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c2d8b31-adc2-46c8-8549-be400f504f80 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:06.344268 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c2d8b31-adc2-46c8-8549-be400f504f80 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:06.344708 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4c2d8b31-adc2-46c8-8549-be400f504f80 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:06.397994 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2c195df5-51cc-4f7d-a9ad-82445cd2f8c2 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2cdcf0d0>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:06.425838 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4c2d8b31-adc2-46c8-8549-be400f504f80 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097901 Dec 16 14:43:06.429909 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 299/589] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:06 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:06.463725 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-2c195df5-51cc-4f7d-a9ad-82445cd2f8c2 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] HTTP exception thrown: Volume 265c4a9f-a98c-4eae-930c-56d31096ff18 could not be found. Dec 16 14:43:06.464349 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2c195df5-51cc-4f7d-a9ad-82445cd2f8c2 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Returning 404 to user: Volume 265c4a9f-a98c-4eae-930c-56d31096ff18 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:06.465591 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2c195df5-51cc-4f7d-a9ad-82445cd2f8c2 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18" status: 404 len: 109 microversion: 2.1 time: 0.071240 Dec 16 14:43:06.466286 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 291/590] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:43:06 2021] GET /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:06.481327 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-98503d7c-dccc-452e-90c7-4529c7e552ae tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2c5b8940>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:06.562116 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-98503d7c-dccc-452e-90c7-4529c7e552ae tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] HTTP exception thrown: Volume 265c4a9f-a98c-4eae-930c-56d31096ff18 could not be found. Dec 16 14:43:06.562704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-98503d7c-dccc-452e-90c7-4529c7e552ae tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Returning 404 to user: Volume 265c4a9f-a98c-4eae-930c-56d31096ff18 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:06.563520 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-98503d7c-dccc-452e-90c7-4529c7e552ae tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18" status: 404 len: 109 microversion: 2.1 time: 0.086102 Dec 16 14:43:06.564056 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 300/591] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Dec 16 14:43:06 2021] DELETE /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:06.578364 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f201b56a-0d5c-4f75-a09c-8547fbe99039 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Calling method '.version_select at 0x7f3c2cdcfca0>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:06.645616 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-f201b56a-0d5c-4f75-a09c-8547fbe99039 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] HTTP exception thrown: Volume 265c4a9f-a98c-4eae-930c-56d31096ff18 could not be found. Dec 16 14:43:06.646218 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f201b56a-0d5c-4f75-a09c-8547fbe99039 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] Returning 404 to user: Volume 265c4a9f-a98c-4eae-930c-56d31096ff18 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:06.647079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f201b56a-0d5c-4f75-a09c-8547fbe99039 tempest-VolumesSnapshotsTestJSON-1265728263 tempest-VolumesSnapshotsTestJSON-1265728263-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18" status: 404 len: 109 microversion: 2.1 time: 0.077648 Dec 16 14:43:06.647749 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 292/592] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:43:06 2021] GET /compute/v2.1/os-volumes/265c4a9f-a98c-4eae-930c-56d31096ff18 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:43:07.441537 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-53ce30c1-78e4-41df-b46e-ea8409e940dc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:07.443040 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-53ce30c1-78e4-41df-b46e-ea8409e940dc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:07.451321 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-53ce30c1-78e4-41df-b46e-ea8409e940dc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:07.451768 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-53ce30c1-78e4-41df-b46e-ea8409e940dc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:07.452811 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-53ce30c1-78e4-41df-b46e-ea8409e940dc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:07.453243 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-53ce30c1-78e4-41df-b46e-ea8409e940dc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:07.523683 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-53ce30c1-78e4-41df-b46e-ea8409e940dc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089014 Dec 16 14:43:07.528310 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 301/593] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:07 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:08.541904 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-80398446-f0bf-4ffd-b1da-81c7ed4a7a96 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:08.544465 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-80398446-f0bf-4ffd-b1da-81c7ed4a7a96 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:08.558590 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-80398446-f0bf-4ffd-b1da-81c7ed4a7a96 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:08.559235 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-80398446-f0bf-4ffd-b1da-81c7ed4a7a96 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:08.560257 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-80398446-f0bf-4ffd-b1da-81c7ed4a7a96 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:08.560926 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-80398446-f0bf-4ffd-b1da-81c7ed4a7a96 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:08.647016 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-80398446-f0bf-4ffd-b1da-81c7ed4a7a96 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114086 Dec 16 14:43:08.648453 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 293/594] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:08 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:09.659354 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7d3122c1-3c66-45d0-bb6e-165d7687e79b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:09.660193 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7d3122c1-3c66-45d0-bb6e-165d7687e79b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:09.667887 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7d3122c1-3c66-45d0-bb6e-165d7687e79b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:09.668345 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7d3122c1-3c66-45d0-bb6e-165d7687e79b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:09.669160 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7d3122c1-3c66-45d0-bb6e-165d7687e79b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:09.669598 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7d3122c1-3c66-45d0-bb6e-165d7687e79b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:09.740875 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7d3122c1-3c66-45d0-bb6e-165d7687e79b tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083703 Dec 16 14:43:09.740875 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 302/595] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:09 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:10.750154 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8ad0520f-23cd-4a1a-9ddb-37d6bec84a02 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:10.751071 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8ad0520f-23cd-4a1a-9ddb-37d6bec84a02 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:10.758635 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8ad0520f-23cd-4a1a-9ddb-37d6bec84a02 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:10.759084 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8ad0520f-23cd-4a1a-9ddb-37d6bec84a02 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:10.759892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8ad0520f-23cd-4a1a-9ddb-37d6bec84a02 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:10.760328 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8ad0520f-23cd-4a1a-9ddb-37d6bec84a02 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:10.837462 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8ad0520f-23cd-4a1a-9ddb-37d6bec84a02 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090747 Dec 16 14:43:10.838142 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 294/596] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:10 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:11.848335 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7e7acd13-6f87-409c-8bf1-1134e06ddf9e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:11.849274 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7e7acd13-6f87-409c-8bf1-1134e06ddf9e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:11.860964 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7e7acd13-6f87-409c-8bf1-1134e06ddf9e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:11.861562 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7e7acd13-6f87-409c-8bf1-1134e06ddf9e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:11.863139 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7e7acd13-6f87-409c-8bf1-1134e06ddf9e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:11.864099 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7e7acd13-6f87-409c-8bf1-1134e06ddf9e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:11.944245 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7e7acd13-6f87-409c-8bf1-1134e06ddf9e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099506 Dec 16 14:43:11.945146 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 303/597] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:43:11 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:43:16.610573 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a368523e-6708-4bbd-afc2-78609d6bc21e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:16.611487 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a368523e-6708-4bbd-afc2-78609d6bc21e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:16.620530 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a368523e-6708-4bbd-afc2-78609d6bc21e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:16.621074 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a368523e-6708-4bbd-afc2-78609d6bc21e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:16.622064 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a368523e-6708-4bbd-afc2-78609d6bc21e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:16.622458 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a368523e-6708-4bbd-afc2-78609d6bc21e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:16.692251 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a368523e-6708-4bbd-afc2-78609d6bc21e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:43:16.876223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a368523e-6708-4bbd-afc2-78609d6bc21e tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "DELETE /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 204 len: 0 microversion: 2.1 time: 0.269214 Dec 16 14:43:16.876461 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 295/598] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:43:16 2021] DELETE /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:43:16.885990 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-58016065-d533-4c66-8f3b-fb90cd3389e8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:16.886765 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-58016065-d533-4c66-8f3b-fb90cd3389e8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:16.900457 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-58016065-d533-4c66-8f3b-fb90cd3389e8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:16.901097 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-58016065-d533-4c66-8f3b-fb90cd3389e8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:16.902192 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-58016065-d533-4c66-8f3b-fb90cd3389e8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:16.902763 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-58016065-d533-4c66-8f3b-fb90cd3389e8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:17.128440 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-58016065-d533-4c66-8f3b-fb90cd3389e8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:17.137538 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-58016065-d533-4c66-8f3b-fb90cd3389e8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1514 microversion: 2.1 time: 0.256667 Dec 16 14:43:17.138126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 304/599] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:16 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:18.156134 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4d635dc7-b960-4553-8876-734645cbb1bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:18.156844 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4d635dc7-b960-4553-8876-734645cbb1bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:18.164248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4d635dc7-b960-4553-8876-734645cbb1bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:18.164689 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4d635dc7-b960-4553-8876-734645cbb1bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:18.165563 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4d635dc7-b960-4553-8876-734645cbb1bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:18.165990 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4d635dc7-b960-4553-8876-734645cbb1bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:18.393731 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4d635dc7-b960-4553-8876-734645cbb1bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:18.404239 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4d635dc7-b960-4553-8876-734645cbb1bf tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1514 microversion: 2.1 time: 0.252652 Dec 16 14:43:18.405111 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 296/600] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:18 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:19.428858 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1fc1fcfb-194d-43a7-bf8b-55f404fd28e3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:19.429785 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1fc1fcfb-194d-43a7-bf8b-55f404fd28e3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:19.437861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1fc1fcfb-194d-43a7-bf8b-55f404fd28e3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:19.438756 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1fc1fcfb-194d-43a7-bf8b-55f404fd28e3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:19.440047 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1fc1fcfb-194d-43a7-bf8b-55f404fd28e3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:19.440326 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1fc1fcfb-194d-43a7-bf8b-55f404fd28e3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:19.743960 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1fc1fcfb-194d-43a7-bf8b-55f404fd28e3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:19.754280 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1fc1fcfb-194d-43a7-bf8b-55f404fd28e3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1514 microversion: 2.1 time: 0.329877 Dec 16 14:43:19.754872 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 305/601] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:19 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:20.773227 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ecad16a8-cb1c-4032-b1d9-5ef780c2e8cc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:20.774315 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ecad16a8-cb1c-4032-b1d9-5ef780c2e8cc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:20.786270 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ecad16a8-cb1c-4032-b1d9-5ef780c2e8cc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:20.787058 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ecad16a8-cb1c-4032-b1d9-5ef780c2e8cc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:20.788464 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ecad16a8-cb1c-4032-b1d9-5ef780c2e8cc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:20.789025 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ecad16a8-cb1c-4032-b1d9-5ef780c2e8cc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:21.046052 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ecad16a8-cb1c-4032-b1d9-5ef780c2e8cc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:21.063226 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ecad16a8-cb1c-4032-b1d9-5ef780c2e8cc tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1514 microversion: 2.1 time: 0.294269 Dec 16 14:43:21.064664 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 297/602] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:20 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:22.081284 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c8ce5c6c-12c5-4a38-96c4-32da2a7220f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:22.082102 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c8ce5c6c-12c5-4a38-96c4-32da2a7220f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:22.090334 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c8ce5c6c-12c5-4a38-96c4-32da2a7220f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:22.090783 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c8ce5c6c-12c5-4a38-96c4-32da2a7220f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:22.091583 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c8ce5c6c-12c5-4a38-96c4-32da2a7220f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:22.092549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c8ce5c6c-12c5-4a38-96c4-32da2a7220f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:22.367067 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c8ce5c6c-12c5-4a38-96c4-32da2a7220f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:22.381794 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c8ce5c6c-12c5-4a38-96c4-32da2a7220f4 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1514 microversion: 2.1 time: 0.303959 Dec 16 14:43:22.389497 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 306/603] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:22 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:22.704598 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-daa7530f-e31d-413c-97af-28da7e8a230a req-03f4ad42-135a-4465-afa1-476456d9ed4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852bc07c-edbd-4753-8055-d84a33315464", "name": "network-vif-deleted", "tag": "526505bf-e823-46fa-a1a2-6e5aff27c04f"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:22.706671 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:22.706671 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:43:22.717260 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-daa7530f-e31d-413c-97af-28da7e8a230a req-03f4ad42-135a-4465-afa1-476456d9ed4a service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:22.720448 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-daa7530f-e31d-413c-97af-28da7e8a230a req-03f4ad42-135a-4465-afa1-476456d9ed4a service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:22.740677 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-daa7530f-e31d-413c-97af-28da7e8a230a req-03f4ad42-135a-4465-afa1-476456d9ed4a service nova] Creating event network-vif-deleted:526505bf-e823-46fa-a1a2-6e5aff27c04f for instance 852bc07c-edbd-4753-8055-d84a33315464 on hv-cinder-82189 Dec 16 14:43:22.746769 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-daa7530f-e31d-413c-97af-28da7e8a230a req-03f4ad42-135a-4465-afa1-476456d9ed4a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047352 Dec 16 14:43:22.750938 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 298/604] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:43:23.403546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:23.404185 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:23.412688 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:23.413318 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:23.414410 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:23.415081 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:23.492923 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:23.493413 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:23.493938 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lazy-loading 'fault' on Instance uuid 852bc07c-edbd-4753-8055-d84a33315464 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:43:23.600363 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:23.610417 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e78a4dee-50b6-4f3d-92c1-52646fcd7cf2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 200 len: 1308 microversion: 2.1 time: 0.210518 Dec 16 14:43:23.611514 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 307/605] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:23 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 1308 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:23.814891 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9367020e-620d-44a7-b941-ddc507d0ae9c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:23.815480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9367020e-620d-44a7-b941-ddc507d0ae9c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:23.824029 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9367020e-620d-44a7-b941-ddc507d0ae9c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:23.824496 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9367020e-620d-44a7-b941-ddc507d0ae9c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:23.825303 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9367020e-620d-44a7-b941-ddc507d0ae9c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:23.825743 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9367020e-620d-44a7-b941-ddc507d0ae9c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:24.006933 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-9367020e-620d-44a7-b941-ddc507d0ae9c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lazy-loading 'services' on Instance uuid f91e2ef5-e95c-4515-a357-42a3a3902b79 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:43:24.153233 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9367020e-620d-44a7-b941-ddc507d0ae9c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79/os-volume_attachments/e2931498-43ea-434f-b5bb-8b2c29ecdf79" status: 202 len: 0 microversion: 2.1 time: 0.342542 Dec 16 14:43:24.153933 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 299/606] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:43:23 2021] DELETE /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79/os-volume_attachments/e2931498-43ea-434f-b5bb-8b2c29ecdf79 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:43:24.628286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f585ccdc-80ee-47a7-9bbf-c75af4e03627 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:24.628868 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f585ccdc-80ee-47a7-9bbf-c75af4e03627 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 852bc07c-edbd-4753-8055-d84a33315464] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:24.636041 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f585ccdc-80ee-47a7-9bbf-c75af4e03627 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:24.636484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f585ccdc-80ee-47a7-9bbf-c75af4e03627 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:24.637279 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f585ccdc-80ee-47a7-9bbf-c75af4e03627 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:24.637715 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f585ccdc-80ee-47a7-9bbf-c75af4e03627 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:24.686319 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-f585ccdc-80ee-47a7-9bbf-c75af4e03627 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] HTTP exception thrown: Instance 852bc07c-edbd-4753-8055-d84a33315464 could not be found. Dec 16 14:43:24.686910 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f585ccdc-80ee-47a7-9bbf-c75af4e03627 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Returning 404 to user: Instance 852bc07c-edbd-4753-8055-d84a33315464 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:24.687718 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f585ccdc-80ee-47a7-9bbf-c75af4e03627 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464" status: 404 len: 111 microversion: 2.1 time: 0.063337 Dec 16 14:43:24.688252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 308/607] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:24 2021] GET /compute/v2.1/servers/852bc07c-edbd-4753-8055-d84a33315464 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:25.405906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-879ae668-2f98-4a35-9215-5a317481e68e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:25.406584 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-879ae668-2f98-4a35-9215-5a317481e68e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:25.414247 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-879ae668-2f98-4a35-9215-5a317481e68e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:25.414737 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-879ae668-2f98-4a35-9215-5a317481e68e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:25.415567 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-879ae668-2f98-4a35-9215-5a317481e68e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:25.416070 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-879ae668-2f98-4a35-9215-5a317481e68e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:25.478276 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-879ae668-2f98-4a35-9215-5a317481e68e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:43:25.598846 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-879ae668-2f98-4a35-9215-5a317481e68e tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 204 len: 0 microversion: 2.1 time: 0.194336 Dec 16 14:43:25.598846 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 300/608] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:43:25 2021] DELETE /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:43:25.606382 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fffa326a-2712-4106-889a-4dfc7644cc8b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:25.607233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fffa326a-2712-4106-889a-4dfc7644cc8b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:25.615251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fffa326a-2712-4106-889a-4dfc7644cc8b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:25.615704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fffa326a-2712-4106-889a-4dfc7644cc8b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:25.616478 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fffa326a-2712-4106-889a-4dfc7644cc8b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:25.617122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fffa326a-2712-4106-889a-4dfc7644cc8b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:25.822709 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fffa326a-2712-4106-889a-4dfc7644cc8b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:25.831671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fffa326a-2712-4106-889a-4dfc7644cc8b tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1514 microversion: 2.1 time: 0.229165 Dec 16 14:43:25.832552 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 309/609] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:25 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:25.930946 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-93ff058b-6a11-4a67-a305-169c3b15d2b6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:25.931523 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-93ff058b-6a11-4a67-a305-169c3b15d2b6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:25.938964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93ff058b-6a11-4a67-a305-169c3b15d2b6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:25.939408 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93ff058b-6a11-4a67-a305-169c3b15d2b6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:25.940161 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93ff058b-6a11-4a67-a305-169c3b15d2b6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:25.940642 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93ff058b-6a11-4a67-a305-169c3b15d2b6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:26.005368 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-93ff058b-6a11-4a67-a305-169c3b15d2b6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:43:26.120546 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-93ff058b-6a11-4a67-a305-169c3b15d2b6 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "DELETE /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 204 len: 0 microversion: 2.1 time: 0.193167 Dec 16 14:43:26.121425 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 301/610] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:43:25 2021] DELETE /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:43:26.129831 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-47e4bfc7-8803-4078-a0ca-c92fe2dc94ef tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:26.130475 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-47e4bfc7-8803-4078-a0ca-c92fe2dc94ef tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:26.137737 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-47e4bfc7-8803-4078-a0ca-c92fe2dc94ef tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:26.138398 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-47e4bfc7-8803-4078-a0ca-c92fe2dc94ef tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:26.139722 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-47e4bfc7-8803-4078-a0ca-c92fe2dc94ef tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:26.140154 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-47e4bfc7-8803-4078-a0ca-c92fe2dc94ef tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:26.422213 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-47e4bfc7-8803-4078-a0ca-c92fe2dc94ef tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:26.430828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-47e4bfc7-8803-4078-a0ca-c92fe2dc94ef tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1513 microversion: 2.1 time: 0.305202 Dec 16 14:43:26.431513 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 310/611] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:26 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:26.850445 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5d24ceba-9b65-449f-8fa9-5dbf53ef01d2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:26.851756 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5d24ceba-9b65-449f-8fa9-5dbf53ef01d2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:26.859785 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d24ceba-9b65-449f-8fa9-5dbf53ef01d2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:26.860227 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d24ceba-9b65-449f-8fa9-5dbf53ef01d2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:26.861259 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d24ceba-9b65-449f-8fa9-5dbf53ef01d2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:26.861694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d24ceba-9b65-449f-8fa9-5dbf53ef01d2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:27.142864 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5d24ceba-9b65-449f-8fa9-5dbf53ef01d2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:27.151002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5d24ceba-9b65-449f-8fa9-5dbf53ef01d2 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1514 microversion: 2.1 time: 0.304745 Dec 16 14:43:27.151570 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 302/612] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:26 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:27.448149 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2cbb8025-1086-4b65-82aa-1a0bb708f350 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:27.448746 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2cbb8025-1086-4b65-82aa-1a0bb708f350 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:27.456119 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2cbb8025-1086-4b65-82aa-1a0bb708f350 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:27.456565 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2cbb8025-1086-4b65-82aa-1a0bb708f350 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:27.457368 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2cbb8025-1086-4b65-82aa-1a0bb708f350 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:27.457796 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2cbb8025-1086-4b65-82aa-1a0bb708f350 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:27.733796 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2cbb8025-1086-4b65-82aa-1a0bb708f350 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:27.745303 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2cbb8025-1086-4b65-82aa-1a0bb708f350 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1513 microversion: 2.1 time: 0.300563 Dec 16 14:43:27.745972 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 311/613] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:27 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:28.167859 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c01dd4af-3e40-45a1-b02b-e38a2acfe46c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:28.169017 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c01dd4af-3e40-45a1-b02b-e38a2acfe46c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:28.176850 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c01dd4af-3e40-45a1-b02b-e38a2acfe46c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:28.177545 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c01dd4af-3e40-45a1-b02b-e38a2acfe46c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:28.178494 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c01dd4af-3e40-45a1-b02b-e38a2acfe46c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:28.179209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c01dd4af-3e40-45a1-b02b-e38a2acfe46c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:28.560957 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-dd40e02d-7860-41f0-9ca6-ac3a3ed1495d req-a50d1b98-79d1-42ce-a900-98c104ce987a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91e2ef5-e95c-4515-a357-42a3a3902b79", "name": "network-vif-deleted", "tag": "4ea72ead-9020-47dd-b54b-ae7b67b61c47"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:28.568165 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:28.568165 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:43:28.579871 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-dd40e02d-7860-41f0-9ca6-ac3a3ed1495d req-a50d1b98-79d1-42ce-a900-98c104ce987a service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:28.580504 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-dd40e02d-7860-41f0-9ca6-ac3a3ed1495d req-a50d1b98-79d1-42ce-a900-98c104ce987a service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:28.611334 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-dd40e02d-7860-41f0-9ca6-ac3a3ed1495d req-a50d1b98-79d1-42ce-a900-98c104ce987a service nova] Creating event network-vif-deleted:4ea72ead-9020-47dd-b54b-ae7b67b61c47 for instance f91e2ef5-e95c-4515-a357-42a3a3902b79 on hv-cinder-82189 Dec 16 14:43:28.618553 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-dd40e02d-7860-41f0-9ca6-ac3a3ed1495d req-a50d1b98-79d1-42ce-a900-98c104ce987a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084690 Dec 16 14:43:28.620068 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 312/614] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:28.653826 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c01dd4af-3e40-45a1-b02b-e38a2acfe46c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0d5bf878154c6fa174db6389f2ea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd04f3d6f9ef4788bb01db0c11ba554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:28.667250 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c01dd4af-3e40-45a1-b02b-e38a2acfe46c tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 200 len: 1514 microversion: 2.1 time: 0.503561 Dec 16 14:43:28.668313 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 303/615] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:28 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 1514 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:28.764222 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-641e02c1-6418-41b7-9779-663d27de2cb8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:28.765213 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-641e02c1-6418-41b7-9779-663d27de2cb8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:28.773439 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-641e02c1-6418-41b7-9779-663d27de2cb8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:28.773981 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-641e02c1-6418-41b7-9779-663d27de2cb8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:28.774871 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-641e02c1-6418-41b7-9779-663d27de2cb8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:28.775384 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-641e02c1-6418-41b7-9779-663d27de2cb8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:29.122250 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-641e02c1-6418-41b7-9779-663d27de2cb8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:29.142818 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-641e02c1-6418-41b7-9779-663d27de2cb8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 200 len: 1513 microversion: 2.1 time: 0.384016 Dec 16 14:43:29.143506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 313/616] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:28 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 1513 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:29.301977 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-2a04f673-0e91-4c79-b970-b418b41b8134 req-f8246a58-177b-4fcb-ab83-f98792a090e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a5a09b-6a73-4b0e-accc-7d9eb35ef787", "name": "network-vif-deleted", "tag": "53319b19-0957-4d2a-bc97-feaecba46759"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:29.313530 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:29.313530 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:43:29.325147 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-2a04f673-0e91-4c79-b970-b418b41b8134 req-f8246a58-177b-4fcb-ab83-f98792a090e3 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:29.325742 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-2a04f673-0e91-4c79-b970-b418b41b8134 req-f8246a58-177b-4fcb-ab83-f98792a090e3 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:29.348175 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-2a04f673-0e91-4c79-b970-b418b41b8134 req-f8246a58-177b-4fcb-ab83-f98792a090e3 service nova] Creating event network-vif-deleted:53319b19-0957-4d2a-bc97-feaecba46759 for instance 25a5a09b-6a73-4b0e-accc-7d9eb35ef787 on hv-cinder-82189 Dec 16 14:43:29.353386 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-2a04f673-0e91-4c79-b970-b418b41b8134 req-f8246a58-177b-4fcb-ab83-f98792a090e3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054903 Dec 16 14:43:29.354699 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 304/617] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:29.683977 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-991b9083-f57c-4504-a7e9-9e9d7c22e465 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:29.684689 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-991b9083-f57c-4504-a7e9-9e9d7c22e465 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] [instance: f91e2ef5-e95c-4515-a357-42a3a3902b79] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:29.692419 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-991b9083-f57c-4504-a7e9-9e9d7c22e465 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:29.692909 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-991b9083-f57c-4504-a7e9-9e9d7c22e465 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:29.693678 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-991b9083-f57c-4504-a7e9-9e9d7c22e465 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:29.694112 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-991b9083-f57c-4504-a7e9-9e9d7c22e465 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:29.745681 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-991b9083-f57c-4504-a7e9-9e9d7c22e465 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] HTTP exception thrown: Instance f91e2ef5-e95c-4515-a357-42a3a3902b79 could not be found. Dec 16 14:43:29.746282 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-991b9083-f57c-4504-a7e9-9e9d7c22e465 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] Returning 404 to user: Instance f91e2ef5-e95c-4515-a357-42a3a3902b79 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:29.747108 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-991b9083-f57c-4504-a7e9-9e9d7c22e465 tempest-VolumesSnapshotTestJSON-6496770 tempest-VolumesSnapshotTestJSON-6496770-project] 10.222.0.64 "GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79" status: 404 len: 111 microversion: 2.1 time: 0.067462 Dec 16 14:43:29.748192 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 314/618] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:29 2021] GET /compute/v2.1/servers/f91e2ef5-e95c-4515-a357-42a3a3902b79 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:30.165888 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0fb1426a-022f-48de-8d0b-b84c0106e45c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:30.167580 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0fb1426a-022f-48de-8d0b-b84c0106e45c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 25a5a09b-6a73-4b0e-accc-7d9eb35ef787] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:30.179262 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0fb1426a-022f-48de-8d0b-b84c0106e45c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:30.180157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0fb1426a-022f-48de-8d0b-b84c0106e45c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:30.182360 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0fb1426a-022f-48de-8d0b-b84c0106e45c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:30.183029 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0fb1426a-022f-48de-8d0b-b84c0106e45c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:30.247981 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-0fb1426a-022f-48de-8d0b-b84c0106e45c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] HTTP exception thrown: Instance 25a5a09b-6a73-4b0e-accc-7d9eb35ef787 could not be found. Dec 16 14:43:30.248585 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0fb1426a-022f-48de-8d0b-b84c0106e45c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Returning 404 to user: Instance 25a5a09b-6a73-4b0e-accc-7d9eb35ef787 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:30.249455 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0fb1426a-022f-48de-8d0b-b84c0106e45c tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787" status: 404 len: 111 microversion: 2.1 time: 0.090681 Dec 16 14:43:30.250026 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 305/619] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:30 2021] GET /compute/v2.1/servers/25a5a09b-6a73-4b0e-accc-7d9eb35ef787 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:30.258266 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a59631bc-a7e9-4897-ad01-d2e79bdfbc0f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:30.258800 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a59631bc-a7e9-4897-ad01-d2e79bdfbc0f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:30.266437 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a59631bc-a7e9-4897-ad01-d2e79bdfbc0f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:30.266887 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a59631bc-a7e9-4897-ad01-d2e79bdfbc0f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:30.267668 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a59631bc-a7e9-4897-ad01-d2e79bdfbc0f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:30.268101 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a59631bc-a7e9-4897-ad01-d2e79bdfbc0f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:30.362752 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a59631bc-a7e9-4897-ad01-d2e79bdfbc0f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Going to try to terminate instance {{(pid=101914) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:43:30.530314 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a59631bc-a7e9-4897-ad01-d2e79bdfbc0f tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 204 len: 0 microversion: 2.1 time: 0.274535 Dec 16 14:43:30.535933 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 315/620] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:43:30 2021] DELETE /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:43:30.545387 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1d19b808-daf2-4f4e-9201-ce774b60f9ff tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:30.546017 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1d19b808-daf2-4f4e-9201-ce774b60f9ff tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:30.553543 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1d19b808-daf2-4f4e-9201-ce774b60f9ff tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:30.554000 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1d19b808-daf2-4f4e-9201-ce774b60f9ff tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:30.554774 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1d19b808-daf2-4f4e-9201-ce774b60f9ff tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:30.555219 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1d19b808-daf2-4f4e-9201-ce774b60f9ff tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:30.774355 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1d19b808-daf2-4f4e-9201-ce774b60f9ff tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:30.783074 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1d19b808-daf2-4f4e-9201-ce774b60f9ff tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1512 microversion: 2.1 time: 0.244831 Dec 16 14:43:30.783646 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 306/621] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:30 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:31.803861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5fb6dae1-39d6-4b67-921d-ab5ee66718a2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:31.805062 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5fb6dae1-39d6-4b67-921d-ab5ee66718a2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:31.825529 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5fb6dae1-39d6-4b67-921d-ab5ee66718a2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:31.825983 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5fb6dae1-39d6-4b67-921d-ab5ee66718a2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:31.826771 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5fb6dae1-39d6-4b67-921d-ab5ee66718a2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:31.827203 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5fb6dae1-39d6-4b67-921d-ab5ee66718a2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:32.054347 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5fb6dae1-39d6-4b67-921d-ab5ee66718a2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:32.062579 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5fb6dae1-39d6-4b67-921d-ab5ee66718a2 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1512 microversion: 2.1 time: 0.265028 Dec 16 14:43:32.063151 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 316/622] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:31 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:33.079285 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ee1df58a-13c8-46da-b865-2ad72fed81f7 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:33.080583 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ee1df58a-13c8-46da-b865-2ad72fed81f7 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:33.088558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee1df58a-13c8-46da-b865-2ad72fed81f7 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:33.089359 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee1df58a-13c8-46da-b865-2ad72fed81f7 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:33.090243 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee1df58a-13c8-46da-b865-2ad72fed81f7 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:33.090965 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee1df58a-13c8-46da-b865-2ad72fed81f7 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:33.291696 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ee1df58a-13c8-46da-b865-2ad72fed81f7 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:33.300156 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ee1df58a-13c8-46da-b865-2ad72fed81f7 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1512 microversion: 2.1 time: 0.224544 Dec 16 14:43:33.300761 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 307/623] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:33 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1512 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:34.317070 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d2779d04-b08f-42fc-a0d4-ab3873b9ec72 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:34.317674 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d2779d04-b08f-42fc-a0d4-ab3873b9ec72 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:34.325271 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d2779d04-b08f-42fc-a0d4-ab3873b9ec72 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:34.325772 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d2779d04-b08f-42fc-a0d4-ab3873b9ec72 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:34.326548 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d2779d04-b08f-42fc-a0d4-ab3873b9ec72 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:34.326976 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d2779d04-b08f-42fc-a0d4-ab3873b9ec72 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:34.532819 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d2779d04-b08f-42fc-a0d4-ab3873b9ec72 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:34.541507 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d2779d04-b08f-42fc-a0d4-ab3873b9ec72 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1512 microversion: 2.1 time: 0.228082 Dec 16 14:43:34.542081 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 317/624] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:34 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:35.345072 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1747237466", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:35.409986 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] validate_networks() for None {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:43:35.559074 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8d2350df-e088-48df-a428-fbba1e1cb844 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:35.559716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8d2350df-e088-48df-a428-fbba1e1cb844 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:35.569050 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8d2350df-e088-48df-a428-fbba1e1cb844 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:35.569504 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8d2350df-e088-48df-a428-fbba1e1cb844 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:35.570399 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8d2350df-e088-48df-a428-fbba1e1cb844 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:35.570914 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8d2350df-e088-48df-a428-fbba1e1cb844 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:35.777476 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8d2350df-e088-48df-a428-fbba1e1cb844 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:35.792261 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8d2350df-e088-48df-a428-fbba1e1cb844 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 200 len: 1470 microversion: 2.1 time: 0.236748 Dec 16 14:43:35.793274 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 318/625] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:35 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:35.808189 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-ddfcf02c-e678-4b67-976a-b3bcf0efb956 req-654ea663-8e6b-4e4c-a401-608871a6b9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19282f1-e400-4c06-a465-9524cd228d7f", "name": "network-vif-deleted", "tag": "3e9e92ef-3756-4082-9f93-e0baddec24b4"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:35.809800 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:35.809800 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:43:35.830259 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-ddfcf02c-e678-4b67-976a-b3bcf0efb956 req-654ea663-8e6b-4e4c-a401-608871a6b9d1 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:35.831081 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-ddfcf02c-e678-4b67-976a-b3bcf0efb956 req-654ea663-8e6b-4e4c-a401-608871a6b9d1 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:35.858430 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-ddfcf02c-e678-4b67-976a-b3bcf0efb956 req-654ea663-8e6b-4e4c-a401-608871a6b9d1 service nova] Creating event network-vif-deleted:3e9e92ef-3756-4082-9f93-e0baddec24b4 for instance e19282f1-e400-4c06-a465-9524cd228d7f on hv-cinder-82189 Dec 16 14:43:35.869132 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-ddfcf02c-e678-4b67-976a-b3bcf0efb956 req-654ea663-8e6b-4e4c-a401-608871a6b9d1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062230 Dec 16 14:43:35.871380 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 319/626] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:43:35.906473 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:43:35.906882 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:43:35.907347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:43:35.907747 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:43:35.908151 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:43:35.916557 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:35.917018 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:35.918703 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:35.919173 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:35.936451 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Getting quotas for project bed21a1e88bf46c49beba44b174b57dd. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:43:35.940606 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Getting quotas for user dd6995638c134e74b541bf0cbb929449 and project bed21a1e88bf46c49beba44b174b57dd. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:43:35.951570 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:43:35.954234 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:43:36.002827 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4b4a72c7-8c4d-476f-a316-b702d81565bf tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661704 Dec 16 14:43:36.003637 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 308/627] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:43:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:43:36.016122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4c855610-8281-45ad-8c60-f8359ac658f7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:36.016994 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4c855610-8281-45ad-8c60-f8359ac658f7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:36.102568 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4c855610-8281-45ad-8c60-f8359ac658f7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:36.110350 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4c855610-8281-45ad-8c60-f8359ac658f7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1215 microversion: 2.1 time: 0.099713 Dec 16 14:43:36.111200 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 320/628] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:36 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:36.431665 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0aab19d2-0a23-4825-81f5-41ce38b17419 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:36.432964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0aab19d2-0a23-4825-81f5-41ce38b17419 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:36.441199 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0aab19d2-0a23-4825-81f5-41ce38b17419 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:36.441639 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0aab19d2-0a23-4825-81f5-41ce38b17419 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:36.442408 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0aab19d2-0a23-4825-81f5-41ce38b17419 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:36.442830 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0aab19d2-0a23-4825-81f5-41ce38b17419 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:36.518191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0aab19d2-0a23-4825-81f5-41ce38b17419 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments/c284bcc1-6b36-48f7-b3bf-1a7341cb1c28" status: 200 len: 194 microversion: 2.20 time: 0.092837 Dec 16 14:43:36.518704 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 309/629] 10.222.0.64 () {60 vars in 1453 bytes} [Thu Dec 16 14:43:36 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments/c284bcc1-6b36-48f7-b3bf-1a7341cb1c28 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:43:36.626039 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9b187c61-7ded-4bf4-8cd5-a699c5719ff2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:36.626559 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9b187c61-7ded-4bf4-8cd5-a699c5719ff2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:36.634436 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9b187c61-7ded-4bf4-8cd5-a699c5719ff2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:36.634914 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9b187c61-7ded-4bf4-8cd5-a699c5719ff2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:36.635712 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9b187c61-7ded-4bf4-8cd5-a699c5719ff2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:36.636138 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9b187c61-7ded-4bf4-8cd5-a699c5719ff2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:36.798193 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-9b187c61-7ded-4bf4-8cd5-a699c5719ff2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lazy-loading 'services' on Instance uuid a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:43:36.809708 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9d89905e-c841-4818-84db-b18777593399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:36.811007 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9d89905e-c841-4818-84db-b18777593399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: e19282f1-e400-4c06-a465-9524cd228d7f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:36.818838 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d89905e-c841-4818-84db-b18777593399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:36.819377 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d89905e-c841-4818-84db-b18777593399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:36.820221 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d89905e-c841-4818-84db-b18777593399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:36.820757 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d89905e-c841-4818-84db-b18777593399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:36.874679 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-9d89905e-c841-4818-84db-b18777593399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] HTTP exception thrown: Instance e19282f1-e400-4c06-a465-9524cd228d7f could not be found. Dec 16 14:43:36.875369 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9d89905e-c841-4818-84db-b18777593399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Returning 404 to user: Instance e19282f1-e400-4c06-a465-9524cd228d7f could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:36.876287 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9d89905e-c841-4818-84db-b18777593399 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f" status: 404 len: 111 microversion: 2.1 time: 0.070335 Dec 16 14:43:36.876954 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 310/630] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:36 2021] GET /compute/v2.1/servers/e19282f1-e400-4c06-a465-9524cd228d7f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:43:36.947534 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9b187c61-7ded-4bf4-8cd5-a699c5719ff2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments/c284bcc1-6b36-48f7-b3bf-1a7341cb1c28" status: 202 len: 0 microversion: 2.20 time: 0.325339 Dec 16 14:43:36.948129 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 321/631] 10.222.0.64 () {60 vars in 1456 bytes} [Thu Dec 16 14:43:36 2021] DELETE /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments/c284bcc1-6b36-48f7-b3bf-1a7341cb1c28 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:43:36.961410 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ed03dd54-1a73-4b7b-b8e1-7aebc2432da5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:36.963211 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ed03dd54-1a73-4b7b-b8e1-7aebc2432da5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:36.977645 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ed03dd54-1a73-4b7b-b8e1-7aebc2432da5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:36.978515 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ed03dd54-1a73-4b7b-b8e1-7aebc2432da5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:36.980062 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ed03dd54-1a73-4b7b-b8e1-7aebc2432da5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:36.980995 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ed03dd54-1a73-4b7b-b8e1-7aebc2432da5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:37.052759 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ed03dd54-1a73-4b7b-b8e1-7aebc2432da5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099240 Dec 16 14:43:37.053838 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 311/632] 10.222.0.64 () {60 vars in 1342 bytes} [Thu Dec 16 14:43:36 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:43:37.127679 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8545d0fd-791e-4fbb-b26e-165b828681d5 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:37.128639 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8545d0fd-791e-4fbb-b26e-165b828681d5 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:37.136265 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8545d0fd-791e-4fbb-b26e-165b828681d5 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:37.136708 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8545d0fd-791e-4fbb-b26e-165b828681d5 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:37.137500 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8545d0fd-791e-4fbb-b26e-165b828681d5 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:37.138210 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8545d0fd-791e-4fbb-b26e-165b828681d5 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:37.332098 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-8545d0fd-791e-4fbb-b26e-165b828681d5 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:37.341636 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8545d0fd-791e-4fbb-b26e-165b828681d5 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1275 microversion: 2.1 time: 0.217406 Dec 16 14:43:37.342446 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 322/633] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:37 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1275 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:38.065599 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8a10ae93-944f-460b-ace9-9bcb4cd33870 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:38.066676 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8a10ae93-944f-460b-ace9-9bcb4cd33870 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:38.076380 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a10ae93-944f-460b-ace9-9bcb4cd33870 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:38.076913 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a10ae93-944f-460b-ace9-9bcb4cd33870 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:38.077744 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a10ae93-944f-460b-ace9-9bcb4cd33870 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:38.078126 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a10ae93-944f-460b-ace9-9bcb4cd33870 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:38.150680 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8a10ae93-944f-460b-ace9-9bcb4cd33870 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089051 Dec 16 14:43:38.151834 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 312/634] 10.222.0.64 () {60 vars in 1342 bytes} [Thu Dec 16 14:43:38 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:43:38.182349 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-529205fd-6ad8-431c-9f1b-bb7b50a0bb6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:38.183115 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-529205fd-6ad8-431c-9f1b-bb7b50a0bb6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:38.192159 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-529205fd-6ad8-431c-9f1b-bb7b50a0bb6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:38.193059 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-529205fd-6ad8-431c-9f1b-bb7b50a0bb6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:38.194065 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-529205fd-6ad8-431c-9f1b-bb7b50a0bb6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:38.194580 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-529205fd-6ad8-431c-9f1b-bb7b50a0bb6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:38.261769 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-529205fd-6ad8-431c-9f1b-bb7b50a0bb6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Going to try to terminate instance {{(pid=101914) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:43:38.363012 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6eabbeaf-58e5-4b19-8cc1-956bc7e8a9ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:38.363808 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6eabbeaf-58e5-4b19-8cc1-956bc7e8a9ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:38.373774 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6eabbeaf-58e5-4b19-8cc1-956bc7e8a9ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:38.374450 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6eabbeaf-58e5-4b19-8cc1-956bc7e8a9ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:38.375418 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6eabbeaf-58e5-4b19-8cc1-956bc7e8a9ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:38.376009 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6eabbeaf-58e5-4b19-8cc1-956bc7e8a9ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:38.388928 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-529205fd-6ad8-431c-9f1b-bb7b50a0bb6a tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "DELETE /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 204 len: 0 microversion: 2.1 time: 0.209022 Dec 16 14:43:38.394017 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 323/635] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:43:38 2021] DELETE /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:43:38.401030 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1869c419-bafb-4f07-ba11-8b51850b59eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:38.401739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1869c419-bafb-4f07-ba11-8b51850b59eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:38.409583 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1869c419-bafb-4f07-ba11-8b51850b59eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:38.410257 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1869c419-bafb-4f07-ba11-8b51850b59eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:38.411046 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1869c419-bafb-4f07-ba11-8b51850b59eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:38.411484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1869c419-bafb-4f07-ba11-8b51850b59eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:38.974324 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1869c419-bafb-4f07-ba11-8b51850b59eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:38.984488 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1869c419-bafb-4f07-ba11-8b51850b59eb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1514 microversion: 2.1 time: 0.588211 Dec 16 14:43:38.985422 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 324/636] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:38 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1514 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:39.065540 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6eabbeaf-58e5-4b19-8cc1-956bc7e8a9ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:39.073767 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6eabbeaf-58e5-4b19-8cc1-956bc7e8a9ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1315 microversion: 2.1 time: 0.718805 Dec 16 14:43:39.074802 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 313/637] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:38 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:39.165424 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-43fede1e-ab01-429c-91c8-76678ac9728d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:39.166630 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-43fede1e-ab01-429c-91c8-76678ac9728d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:39.177204 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-43fede1e-ab01-429c-91c8-76678ac9728d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:39.177738 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-43fede1e-ab01-429c-91c8-76678ac9728d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:39.179177 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-43fede1e-ab01-429c-91c8-76678ac9728d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:39.179691 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-43fede1e-ab01-429c-91c8-76678ac9728d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:39.270810 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-43fede1e-ab01-429c-91c8-76678ac9728d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.110784 Dec 16 14:43:39.271571 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 325/638] 10.222.0.64 () {60 vars in 1342 bytes} [Thu Dec 16 14:43:39 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:39.382120 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3f0edb36-9f9b-4dd0-81b1-ce9161b4b661 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:39.382529 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3f0edb36-9f9b-4dd0-81b1-ce9161b4b661 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:39.390734 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3f0edb36-9f9b-4dd0-81b1-ce9161b4b661 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:39.391371 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3f0edb36-9f9b-4dd0-81b1-ce9161b4b661 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:39.392280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3f0edb36-9f9b-4dd0-81b1-ce9161b4b661 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:39.392861 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3f0edb36-9f9b-4dd0-81b1-ce9161b4b661 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:39.459027 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3f0edb36-9f9b-4dd0-81b1-ce9161b4b661 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:43:39.580095 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3f0edb36-9f9b-4dd0-81b1-ce9161b4b661 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 204 len: 0 microversion: 2.20 time: 0.202239 Dec 16 14:43:39.580919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 314/639] 10.222.0.64 () {60 vars in 1279 bytes} [Thu Dec 16 14:43:39 2021] DELETE /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:43:39.589960 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-75a8601c-b288-462f-940e-a6add76679c6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:39.590503 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-75a8601c-b288-462f-940e-a6add76679c6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:39.599554 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-75a8601c-b288-462f-940e-a6add76679c6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:39.600028 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-75a8601c-b288-462f-940e-a6add76679c6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:39.600853 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-75a8601c-b288-462f-940e-a6add76679c6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:39.601286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-75a8601c-b288-462f-940e-a6add76679c6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:39.847273 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-3025e873-266f-49f7-be95-f094f44e8db2 req-23070207-0bed-4ae0-bb75-b5dc5c03c124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65981206-fc07-4d04-b940-1718b46f008f", "tag": "641e8b5b-c459-4be8-80b9-1e51a5562e77"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:39.849453 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:39.849453 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:43:39.859192 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-3025e873-266f-49f7-be95-f094f44e8db2 req-23070207-0bed-4ae0-bb75-b5dc5c03c124 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:39.859618 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-3025e873-266f-49f7-be95-f094f44e8db2 req-23070207-0bed-4ae0-bb75-b5dc5c03c124 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:39.894805 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-3025e873-266f-49f7-be95-f094f44e8db2 req-23070207-0bed-4ae0-bb75-b5dc5c03c124 service nova] Creating event network-changed:641e8b5b-c459-4be8-80b9-1e51a5562e77 for instance 65981206-fc07-4d04-b940-1718b46f008f on hv-cinder-82189 Dec 16 14:43:39.901556 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-3025e873-266f-49f7-be95-f094f44e8db2 req-23070207-0bed-4ae0-bb75-b5dc5c03c124 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058581 Dec 16 14:43:39.902491 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 315/640] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:39.920603 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-75a8601c-b288-462f-940e-a6add76679c6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:39.929786 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-75a8601c-b288-462f-940e-a6add76679c6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:39.931279 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-75a8601c-b288-462f-940e-a6add76679c6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:39.932422 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-75a8601c-b288-462f-940e-a6add76679c6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.346953 Dec 16 14:43:39.933009 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 326/641] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:39 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:43:40.003593 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5d599a99-5f5d-4e88-86a9-3a37ede7fad8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:40.004595 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5d599a99-5f5d-4e88-86a9-3a37ede7fad8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:40.013153 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d599a99-5f5d-4e88-86a9-3a37ede7fad8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:40.013613 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d599a99-5f5d-4e88-86a9-3a37ede7fad8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:40.014541 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d599a99-5f5d-4e88-86a9-3a37ede7fad8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:40.014894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d599a99-5f5d-4e88-86a9-3a37ede7fad8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:40.099120 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-242a7436-10a2-46d5-ad4e-38944097c207 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:40.099719 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-242a7436-10a2-46d5-ad4e-38944097c207 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:40.107460 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-242a7436-10a2-46d5-ad4e-38944097c207 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:40.107896 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-242a7436-10a2-46d5-ad4e-38944097c207 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:40.108644 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-242a7436-10a2-46d5-ad4e-38944097c207 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:40.109095 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-242a7436-10a2-46d5-ad4e-38944097c207 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:40.399671 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5d599a99-5f5d-4e88-86a9-3a37ede7fad8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:40.409500 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5d599a99-5f5d-4e88-86a9-3a37ede7fad8 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1514 microversion: 2.1 time: 0.410893 Dec 16 14:43:40.410914 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 316/642] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:39 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1514 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:40.476472 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-242a7436-10a2-46d5-ad4e-38944097c207 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:40.490872 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-242a7436-10a2-46d5-ad4e-38944097c207 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1315 microversion: 2.1 time: 0.394546 Dec 16 14:43:40.498008 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 327/643] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:40 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:40.951588 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fa025e05-541b-48ac-ba9f-28c08867c024 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:40.952191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fa025e05-541b-48ac-ba9f-28c08867c024 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:40.959458 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa025e05-541b-48ac-ba9f-28c08867c024 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:40.959948 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa025e05-541b-48ac-ba9f-28c08867c024 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:40.960751 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa025e05-541b-48ac-ba9f-28c08867c024 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:40.961185 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fa025e05-541b-48ac-ba9f-28c08867c024 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:41.157984 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fa025e05-541b-48ac-ba9f-28c08867c024 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:41.167462 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fa025e05-541b-48ac-ba9f-28c08867c024 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:41.169050 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fa025e05-541b-48ac-ba9f-28c08867c024 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:41.170199 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fa025e05-541b-48ac-ba9f-28c08867c024 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.222970 Dec 16 14:43:41.170951 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 317/644] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:40 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:43:41.222873 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-b25877a8-1384-4e7d-a0ef-f973bd34541d req-39e62caa-f65b-4f27-b6fc-4e1050bbd91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ce9264-74df-434c-ad40-ecf44eb504b7", "name": "network-vif-deleted", "tag": "e53554ce-cefb-44ad-a028-c910c35ef033"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:41.224624 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:41.224624 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:43:41.232996 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-b25877a8-1384-4e7d-a0ef-f973bd34541d req-39e62caa-f65b-4f27-b6fc-4e1050bbd91f service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:41.233436 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-b25877a8-1384-4e7d-a0ef-f973bd34541d req-39e62caa-f65b-4f27-b6fc-4e1050bbd91f service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:41.249551 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-b25877a8-1384-4e7d-a0ef-f973bd34541d req-39e62caa-f65b-4f27-b6fc-4e1050bbd91f service nova] Creating event network-vif-deleted:e53554ce-cefb-44ad-a028-c910c35ef033 for instance 01ce9264-74df-434c-ad40-ecf44eb504b7 on hv-cinder-82189 Dec 16 14:43:41.254236 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-b25877a8-1384-4e7d-a0ef-f973bd34541d req-39e62caa-f65b-4f27-b6fc-4e1050bbd91f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035028 Dec 16 14:43:41.254808 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 328/645] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:41.426454 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3d67557b-19b3-4a0b-b918-2c60eb629feb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:41.427019 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3d67557b-19b3-4a0b-b918-2c60eb629feb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:41.434278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d67557b-19b3-4a0b-b918-2c60eb629feb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:41.435390 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d67557b-19b3-4a0b-b918-2c60eb629feb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:41.436156 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d67557b-19b3-4a0b-b918-2c60eb629feb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:41.436592 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3d67557b-19b3-4a0b-b918-2c60eb629feb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:41.515333 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2b998641-3d98-4433-8756-0823e99e9239 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:41.516042 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2b998641-3d98-4433-8756-0823e99e9239 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:41.524060 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b998641-3d98-4433-8756-0823e99e9239 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:41.524500 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b998641-3d98-4433-8756-0823e99e9239 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:41.525333 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b998641-3d98-4433-8756-0823e99e9239 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:41.525766 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b998641-3d98-4433-8756-0823e99e9239 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:41.738353 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-3d67557b-19b3-4a0b-b918-2c60eb629feb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:41.746525 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3d67557b-19b3-4a0b-b918-2c60eb629feb tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1472 microversion: 2.1 time: 0.323785 Dec 16 14:43:41.747818 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 318/646] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:41 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:41.764419 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2b998641-3d98-4433-8756-0823e99e9239 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:41.772346 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2b998641-3d98-4433-8756-0823e99e9239 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1315 microversion: 2.1 time: 0.261527 Dec 16 14:43:41.772920 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 329/647] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:41 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:42.187694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4e366e96-0efb-41df-b356-5623cd39eed8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:42.188301 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4e366e96-0efb-41df-b356-5623cd39eed8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:42.195610 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e366e96-0efb-41df-b356-5623cd39eed8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:42.196212 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e366e96-0efb-41df-b356-5623cd39eed8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:42.197039 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e366e96-0efb-41df-b356-5623cd39eed8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:42.197477 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e366e96-0efb-41df-b356-5623cd39eed8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:42.458194 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4e366e96-0efb-41df-b356-5623cd39eed8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:42.468431 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4e366e96-0efb-41df-b356-5623cd39eed8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:42.469958 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4e366e96-0efb-41df-b356-5623cd39eed8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:42.471130 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4e366e96-0efb-41df-b356-5623cd39eed8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.287217 Dec 16 14:43:42.471661 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 319/648] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:42 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:43:42.764527 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ebcd6a16-a89d-4f32-b751-873130e38f13 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:42.765093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ebcd6a16-a89d-4f32-b751-873130e38f13 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:42.772147 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ebcd6a16-a89d-4f32-b751-873130e38f13 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:42.772587 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ebcd6a16-a89d-4f32-b751-873130e38f13 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:42.773370 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ebcd6a16-a89d-4f32-b751-873130e38f13 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:42.773789 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ebcd6a16-a89d-4f32-b751-873130e38f13 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:42.788472 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-83b0897a-8761-4c84-aca7-627676a86c4f tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:42.789093 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-83b0897a-8761-4c84-aca7-627676a86c4f tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:42.796207 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83b0897a-8761-4c84-aca7-627676a86c4f tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:42.796650 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83b0897a-8761-4c84-aca7-627676a86c4f tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:42.797440 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83b0897a-8761-4c84-aca7-627676a86c4f tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:42.797865 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83b0897a-8761-4c84-aca7-627676a86c4f tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:42.915029 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ebcd6a16-a89d-4f32-b751-873130e38f13 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:42.923766 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ebcd6a16-a89d-4f32-b751-873130e38f13 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1472 microversion: 2.1 time: 0.163563 Dec 16 14:43:42.924332 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 330/649] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:42 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:43.011255 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-83b0897a-8761-4c84-aca7-627676a86c4f tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:43.019836 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-83b0897a-8761-4c84-aca7-627676a86c4f tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1315 microversion: 2.1 time: 0.234882 Dec 16 14:43:43.020329 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 320/650] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:42 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:43.489271 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-02a9ad0d-fbfe-4b54-8cd7-1a0ad10b51ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:43.489902 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-02a9ad0d-fbfe-4b54-8cd7-1a0ad10b51ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:43.497195 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-02a9ad0d-fbfe-4b54-8cd7-1a0ad10b51ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:43.497642 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-02a9ad0d-fbfe-4b54-8cd7-1a0ad10b51ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:43.498402 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-02a9ad0d-fbfe-4b54-8cd7-1a0ad10b51ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:43.498842 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-02a9ad0d-fbfe-4b54-8cd7-1a0ad10b51ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:43.686574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-02a9ad0d-fbfe-4b54-8cd7-1a0ad10b51ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:43.695348 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-02a9ad0d-fbfe-4b54-8cd7-1a0ad10b51ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:43.696907 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-02a9ad0d-fbfe-4b54-8cd7-1a0ad10b51ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:43.698019 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-02a9ad0d-fbfe-4b54-8cd7-1a0ad10b51ba tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.212603 Dec 16 14:43:43.698574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 331/651] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:43 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:43:43.941442 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:43.942615 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:43.950759 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:43.951301 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:43.952154 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:43.952662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:44.022483 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:44.022932 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:44.023382 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lazy-loading 'fault' on Instance uuid 01ce9264-74df-434c-ad40-ecf44eb504b7 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:43:44.036207 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f4607294-5a77-4597-bc71-0626ef37b0db tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:44.036739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f4607294-5a77-4597-bc71-0626ef37b0db tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:44.043945 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f4607294-5a77-4597-bc71-0626ef37b0db tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:44.044385 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f4607294-5a77-4597-bc71-0626ef37b0db tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:44.045184 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f4607294-5a77-4597-bc71-0626ef37b0db tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:44.045612 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f4607294-5a77-4597-bc71-0626ef37b0db tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:44.098054 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb2dde456a8408d820d765c54f8a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a10c6d1e7e7425bb59f6efad4231db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:44.106051 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a29f6f62-f537-45dd-8c2c-877d459afe54 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 200 len: 1308 microversion: 2.1 time: 0.169085 Dec 16 14:43:44.115510 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 321/652] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:43 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:44.316400 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f4607294-5a77-4597-bc71-0626ef37b0db tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:44.324500 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f4607294-5a77-4597-bc71-0626ef37b0db tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1315 microversion: 2.1 time: 0.292415 Dec 16 14:43:44.334075 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 332/653] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:44 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:44.717193 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-29a94ac0-76f1-4f1a-93f3-72174e3799cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:44.717790 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-29a94ac0-76f1-4f1a-93f3-72174e3799cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:44.724994 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-29a94ac0-76f1-4f1a-93f3-72174e3799cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:44.725438 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-29a94ac0-76f1-4f1a-93f3-72174e3799cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:44.726204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-29a94ac0-76f1-4f1a-93f3-72174e3799cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:44.726630 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-29a94ac0-76f1-4f1a-93f3-72174e3799cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:45.123642 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8f9a4137-8034-4de8-a6e6-cd695a9773d3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:45.124765 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8f9a4137-8034-4de8-a6e6-cd695a9773d3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] [instance: 01ce9264-74df-434c-ad40-ecf44eb504b7] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:45.125219 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-29a94ac0-76f1-4f1a-93f3-72174e3799cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:45.135264 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8f9a4137-8034-4de8-a6e6-cd695a9773d3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:45.135722 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-29a94ac0-76f1-4f1a-93f3-72174e3799cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:45.136182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8f9a4137-8034-4de8-a6e6-cd695a9773d3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:45.137106 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8f9a4137-8034-4de8-a6e6-cd695a9773d3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:45.138013 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8f9a4137-8034-4de8-a6e6-cd695a9773d3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:45.138433 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-29a94ac0-76f1-4f1a-93f3-72174e3799cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:45.139855 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-29a94ac0-76f1-4f1a-93f3-72174e3799cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1724 microversion: 2.20 time: 0.426337 Dec 16 14:43:45.152521 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 322/654] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:44 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1724 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:43:45.194986 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-8f9a4137-8034-4de8-a6e6-cd695a9773d3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] HTTP exception thrown: Instance 01ce9264-74df-434c-ad40-ecf44eb504b7 could not be found. Dec 16 14:43:45.195829 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8f9a4137-8034-4de8-a6e6-cd695a9773d3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] Returning 404 to user: Instance 01ce9264-74df-434c-ad40-ecf44eb504b7 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:45.196733 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8f9a4137-8034-4de8-a6e6-cd695a9773d3 tempest-AttachVolumeNegativeTest-933402342 tempest-AttachVolumeNegativeTest-933402342-project] 10.222.0.64 "GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7" status: 404 len: 111 microversion: 2.1 time: 0.077553 Dec 16 14:43:45.198713 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 333/655] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:45 2021] GET /compute/v2.1/servers/01ce9264-74df-434c-ad40-ecf44eb504b7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:43:45.342239 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-df433e9d-96c2-4995-ba4a-2310374ab9de tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:45.343206 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-df433e9d-96c2-4995-ba4a-2310374ab9de tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:45.355541 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-df433e9d-96c2-4995-ba4a-2310374ab9de tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:45.357284 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-df433e9d-96c2-4995-ba4a-2310374ab9de tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:45.359486 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-df433e9d-96c2-4995-ba4a-2310374ab9de tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:45.360033 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-df433e9d-96c2-4995-ba4a-2310374ab9de tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:45.785933 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-df433e9d-96c2-4995-ba4a-2310374ab9de tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:45.795100 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-df433e9d-96c2-4995-ba4a-2310374ab9de tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1315 microversion: 2.1 time: 0.457360 Dec 16 14:43:45.795842 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 323/656] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:45 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:46.158425 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d717abbe-28e7-4ae6-85f9-e297167efa99 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:46.159785 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d717abbe-28e7-4ae6-85f9-e297167efa99 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:46.172437 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d717abbe-28e7-4ae6-85f9-e297167efa99 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:46.172916 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d717abbe-28e7-4ae6-85f9-e297167efa99 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:46.173697 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d717abbe-28e7-4ae6-85f9-e297167efa99 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:46.174132 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d717abbe-28e7-4ae6-85f9-e297167efa99 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:46.346894 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d717abbe-28e7-4ae6-85f9-e297167efa99 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:46.355893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d717abbe-28e7-4ae6-85f9-e297167efa99 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:46.358040 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d717abbe-28e7-4ae6-85f9-e297167efa99 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:46.359601 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d717abbe-28e7-4ae6-85f9-e297167efa99 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 200 len: 1656 microversion: 2.20 time: 0.205061 Dec 16 14:43:46.360617 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 334/657] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:46 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 1656 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:43:46.463970 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-cdf0fdb5-fca3-471b-89a4-d224f06c359a req-374cae58-44f7-4b77-820a-36eac6ca0a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e7a3c6-dc99-4927-83c2-dd8ba87239b2", "name": "network-vif-deleted", "tag": "3086416d-8f44-45e7-a877-073ca8530605"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:46.467451 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:46.467451 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:43:46.483668 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-cdf0fdb5-fca3-471b-89a4-d224f06c359a req-374cae58-44f7-4b77-820a-36eac6ca0a8d service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:46.484108 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-cdf0fdb5-fca3-471b-89a4-d224f06c359a req-374cae58-44f7-4b77-820a-36eac6ca0a8d service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:46.519425 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-cdf0fdb5-fca3-471b-89a4-d224f06c359a req-374cae58-44f7-4b77-820a-36eac6ca0a8d service nova] Creating event network-vif-deleted:3086416d-8f44-45e7-a877-073ca8530605 for instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 on hv-cinder-82189 Dec 16 14:43:46.525251 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-cdf0fdb5-fca3-471b-89a4-d224f06c359a req-374cae58-44f7-4b77-820a-36eac6ca0a8d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065734 Dec 16 14:43:46.526099 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 324/658] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:46.813028 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5d599d83-3a18-407f-9027-05640013d336 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:46.814023 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5d599d83-3a18-407f-9027-05640013d336 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:46.826694 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5d599d83-3a18-407f-9027-05640013d336 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:46.827216 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5d599d83-3a18-407f-9027-05640013d336 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:46.830475 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5d599d83-3a18-407f-9027-05640013d336 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:46.832211 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5d599d83-3a18-407f-9027-05640013d336 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:47.161494 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5d599d83-3a18-407f-9027-05640013d336 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:47.178325 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5d599d83-3a18-407f-9027-05640013d336 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1315 microversion: 2.1 time: 0.368831 Dec 16 14:43:47.185670 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 335/659] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:46 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:47.378806 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-735d1f1f-9dfc-4ee2-8781-7727c5bb9e2c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:47.379847 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-735d1f1f-9dfc-4ee2-8781-7727c5bb9e2c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:47.388464 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-735d1f1f-9dfc-4ee2-8781-7727c5bb9e2c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:47.388955 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-735d1f1f-9dfc-4ee2-8781-7727c5bb9e2c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:47.389984 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-735d1f1f-9dfc-4ee2-8781-7727c5bb9e2c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:47.390615 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-735d1f1f-9dfc-4ee2-8781-7727c5bb9e2c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:47.443017 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-735d1f1f-9dfc-4ee2-8781-7727c5bb9e2c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] HTTP exception thrown: Instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 could not be found. Dec 16 14:43:47.443657 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-735d1f1f-9dfc-4ee2-8781-7727c5bb9e2c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Returning 404 to user: Instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:47.444570 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-735d1f1f-9dfc-4ee2-8781-7727c5bb9e2c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 404 len: 111 microversion: 2.20 time: 0.069968 Dec 16 14:43:47.445166 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 325/660] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:47 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:43:47.453588 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5dee5a86-99ee-4e52-ab0f-6b08e698fccf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '.version_select at 0x7f3c2c384160>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:47.477551 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5dee5a86-99ee-4e52-ab0f-6b08e698fccf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934139766" status: 204 len: 0 microversion: 2.20 time: 0.027631 Dec 16 14:43:47.495965 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 336/661] 10.222.0.64 () {60 vars in 1261 bytes} [Thu Dec 16 14:43:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934139766 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:43:48.196553 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-695285d6-135f-43d2-82aa-8fe8a00eeb31 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:48.197222 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-695285d6-135f-43d2-82aa-8fe8a00eeb31 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:48.210515 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-695285d6-135f-43d2-82aa-8fe8a00eeb31 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:48.216750 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-695285d6-135f-43d2-82aa-8fe8a00eeb31 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:48.217931 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-695285d6-135f-43d2-82aa-8fe8a00eeb31 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:48.218101 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-695285d6-135f-43d2-82aa-8fe8a00eeb31 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:48.283790 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-2137c7e4-79fb-4275-b800-de3742cad97d req-679bd3c0-41da-459f-9324-d7074e0c3e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65981206-fc07-4d04-b940-1718b46f008f", "name": "network-vif-plugged", "status": "completed", "tag": "641e8b5b-c459-4be8-80b9-1e51a5562e77"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:48.285984 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:48.285984 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:43:48.313620 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-2137c7e4-79fb-4275-b800-de3742cad97d req-679bd3c0-41da-459f-9324-d7074e0c3e80 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:48.317173 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-2137c7e4-79fb-4275-b800-de3742cad97d req-679bd3c0-41da-459f-9324-d7074e0c3e80 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:48.357922 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-2137c7e4-79fb-4275-b800-de3742cad97d req-679bd3c0-41da-459f-9324-d7074e0c3e80 service nova] Creating event network-vif-plugged:641e8b5b-c459-4be8-80b9-1e51a5562e77 for instance 65981206-fc07-4d04-b940-1718b46f008f on hv-cinder-82189 Dec 16 14:43:48.368138 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-2137c7e4-79fb-4275-b800-de3742cad97d req-679bd3c0-41da-459f-9324-d7074e0c3e80 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087895 Dec 16 14:43:48.370937 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 337/662] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:43:48.953651 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-695285d6-135f-43d2-82aa-8fe8a00eeb31 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:48.961938 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-695285d6-135f-43d2-82aa-8fe8a00eeb31 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1315 microversion: 2.1 time: 0.768963 Dec 16 14:43:48.962431 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 326/663] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:48 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:49.171244 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7d2e5a90-496d-4672-adfc-2b153d2dc85e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'create', calling method: .version_select at 0x7f3c2c44d0d0>, body: {"keypair": {"name": "tempest-keypair-1476088998"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:49.208140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-7d2e5a90-496d-4672-adfc-2b153d2dc85e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for project 431320546381414684830eb2bc36deef. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:43:49.213091 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-7d2e5a90-496d-4672-adfc-2b153d2dc85e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for user 18d85bcc0aeb413aa2ade769fd10e431 and project 431320546381414684830eb2bc36deef. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:43:49.459877 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-7d2e5a90-496d-4672-adfc-2b153d2dc85e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for project 431320546381414684830eb2bc36deef. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:43:49.463850 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-7d2e5a90-496d-4672-adfc-2b153d2dc85e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for user 18d85bcc0aeb413aa2ade769fd10e431 and project 431320546381414684830eb2bc36deef. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:43:49.476977 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7d2e5a90-496d-4672-adfc-2b153d2dc85e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.309777 Dec 16 14:43:49.477701 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 338/664] 10.222.0.64 () {62 vars in 1198 bytes} [Thu Dec 16 14:43:49 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 311 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:43:49.979709 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-379b77ea-eea6-4278-a663-9cc9e58192ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:49.980474 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-379b77ea-eea6-4278-a663-9cc9e58192ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:49.990897 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-379b77ea-eea6-4278-a663-9cc9e58192ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:49.991662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-379b77ea-eea6-4278-a663-9cc9e58192ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:49.992655 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-379b77ea-eea6-4278-a663-9cc9e58192ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:49.993342 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-379b77ea-eea6-4278-a663-9cc9e58192ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:50.298261 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-379b77ea-eea6-4278-a663-9cc9e58192ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:50.306449 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-379b77ea-eea6-4278-a663-9cc9e58192ea tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1315 microversion: 2.1 time: 0.331242 Dec 16 14:43:50.307010 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 327/665] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:49 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:51.323743 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9160924f-d0a3-4b02-b4b7-4521ab8abdfc tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:51.324449 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9160924f-d0a3-4b02-b4b7-4521ab8abdfc tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:51.332676 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9160924f-d0a3-4b02-b4b7-4521ab8abdfc tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:51.333159 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9160924f-d0a3-4b02-b4b7-4521ab8abdfc tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:51.333957 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9160924f-d0a3-4b02-b4b7-4521ab8abdfc tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:51.334379 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9160924f-d0a3-4b02-b4b7-4521ab8abdfc tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:51.492728 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-572359496", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63997e9c-5e41-48b1-b719-91db81ce0d01"}], "security_groups": [{"name": "tempest-securitygroup--1349533892"}], "key_name": "tempest-keypair-1476088998", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:51.535221 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9160924f-d0a3-4b02-b4b7-4521ab8abdfc tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:51.543953 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9160924f-d0a3-4b02-b4b7-4521ab8abdfc tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1465 microversion: 2.1 time: 0.223886 Dec 16 14:43:51.544523 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 339/666] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:51 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1465 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:43:51.615065 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c809153e-e1a1-415f-869c-1a38501738a7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:51.615555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c809153e-e1a1-415f-869c-1a38501738a7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:51.623230 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] validate_networks() for [('63997e9c-5e41-48b1-b719-91db81ce0d01', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:43:51.623420 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c809153e-e1a1-415f-869c-1a38501738a7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:51.623907 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c809153e-e1a1-415f-869c-1a38501738a7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:51.624687 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c809153e-e1a1-415f-869c-1a38501738a7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:51.625152 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c809153e-e1a1-415f-869c-1a38501738a7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:51.688105 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c809153e-e1a1-415f-869c-1a38501738a7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Going to try to terminate instance {{(pid=101914) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:43:51.801984 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c809153e-e1a1-415f-869c-1a38501738a7 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "DELETE /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 204 len: 0 microversion: 2.1 time: 0.190204 Dec 16 14:43:51.802840 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 340/667] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:43:51 2021] DELETE /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:43:51.811788 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a7cb6228-923d-4ff4-91f4-fe300dd23836 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:51.812569 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a7cb6228-923d-4ff4-91f4-fe300dd23836 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:51.820305 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a7cb6228-923d-4ff4-91f4-fe300dd23836 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:51.820883 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a7cb6228-923d-4ff4-91f4-fe300dd23836 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:51.821736 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a7cb6228-923d-4ff4-91f4-fe300dd23836 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:51.822286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a7cb6228-923d-4ff4-91f4-fe300dd23836 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:52.144682 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a7cb6228-923d-4ff4-91f4-fe300dd23836 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:52.155000 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a7cb6228-923d-4ff4-91f4-fe300dd23836 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1471 microversion: 2.1 time: 0.346971 Dec 16 14:43:52.155933 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 341/668] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:51 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:52.317214 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:43:52.317632 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:43:52.318094 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:43:52.318520 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:43:52.318924 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:43:52.327662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:52.328098 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:52.328919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:52.329339 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:52.345761 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for project 431320546381414684830eb2bc36deef. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:43:52.349641 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Getting quotas for user 18d85bcc0aeb413aa2ade769fd10e431 and project 431320546381414684830eb2bc36deef. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:43:52.359875 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:43:52.362157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:43:52.408019 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-46a635ec-2930-444e-8fde-319a1b0cf8f1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.919396 Dec 16 14:43:52.408641 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 328/669] 10.222.0.64 () {62 vars in 1187 bytes} [Thu Dec 16 14:43:51 2021] POST /compute/v2.1/servers => generated 402 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 16 14:43:52.419215 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ec558b32-e622-4719-af5c-138b714813da tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:52.419895 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ec558b32-e622-4719-af5c-138b714813da tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:52.494275 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ec558b32-e622-4719-af5c-138b714813da tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:52.503055 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ec558b32-e622-4719-af5c-138b714813da tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:52.504556 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ec558b32-e622-4719-af5c-138b714813da tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:52.505653 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ec558b32-e622-4719-af5c-138b714813da tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1281 microversion: 2.20 time: 0.090256 Dec 16 14:43:52.506197 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 342/670] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:52 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:43:53.172911 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-089c2b6e-22f9-4ede-a225-d91aa88db8f3 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:53.174049 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-089c2b6e-22f9-4ede-a225-d91aa88db8f3 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:53.181718 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-089c2b6e-22f9-4ede-a225-d91aa88db8f3 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:53.182182 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-089c2b6e-22f9-4ede-a225-d91aa88db8f3 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:53.182971 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-089c2b6e-22f9-4ede-a225-d91aa88db8f3 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:53.183434 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-089c2b6e-22f9-4ede-a225-d91aa88db8f3 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:53.380490 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-089c2b6e-22f9-4ede-a225-d91aa88db8f3 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:53.389808 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-089c2b6e-22f9-4ede-a225-d91aa88db8f3 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1471 microversion: 2.1 time: 0.220559 Dec 16 14:43:53.390374 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 329/671] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:53 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:53.523644 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-98c12531-aa87-4718-9dde-17111feebae9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:53.524275 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-98c12531-aa87-4718-9dde-17111feebae9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:53.532100 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-98c12531-aa87-4718-9dde-17111feebae9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:53.532546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-98c12531-aa87-4718-9dde-17111feebae9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:53.533348 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-98c12531-aa87-4718-9dde-17111feebae9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:53.533786 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-98c12531-aa87-4718-9dde-17111feebae9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:53.645730 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-98c12531-aa87-4718-9dde-17111feebae9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:53.654215 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-98c12531-aa87-4718-9dde-17111feebae9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:53.655726 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-98c12531-aa87-4718-9dde-17111feebae9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:53.656802 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-98c12531-aa87-4718-9dde-17111feebae9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1285 microversion: 2.20 time: 0.136917 Dec 16 14:43:53.657359 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 343/672] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:53 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:43:54.407287 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d17dfb6e-3dc7-4fb0-9f60-59ac23266257 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:54.407894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d17dfb6e-3dc7-4fb0-9f60-59ac23266257 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:54.415493 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d17dfb6e-3dc7-4fb0-9f60-59ac23266257 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:54.415968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d17dfb6e-3dc7-4fb0-9f60-59ac23266257 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:54.416793 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d17dfb6e-3dc7-4fb0-9f60-59ac23266257 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:54.417228 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d17dfb6e-3dc7-4fb0-9f60-59ac23266257 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:54.674602 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-480414ed-e663-4d3e-be83-c7b9e58c647d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:54.675186 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-480414ed-e663-4d3e-be83-c7b9e58c647d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:54.682156 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d17dfb6e-3dc7-4fb0-9f60-59ac23266257 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:54.682656 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-480414ed-e663-4d3e-be83-c7b9e58c647d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:54.683115 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-480414ed-e663-4d3e-be83-c7b9e58c647d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:54.684424 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-480414ed-e663-4d3e-be83-c7b9e58c647d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:54.684877 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-480414ed-e663-4d3e-be83-c7b9e58c647d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:54.690804 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d17dfb6e-3dc7-4fb0-9f60-59ac23266257 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1471 microversion: 2.1 time: 0.287189 Dec 16 14:43:54.691359 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 330/673] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:54 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:54.792703 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-480414ed-e663-4d3e-be83-c7b9e58c647d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:54.801222 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-480414ed-e663-4d3e-be83-c7b9e58c647d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:54.802748 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-480414ed-e663-4d3e-be83-c7b9e58c647d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:54.803800 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-480414ed-e663-4d3e-be83-c7b9e58c647d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1285 microversion: 2.20 time: 0.133438 Dec 16 14:43:54.804351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 344/674] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:54 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:43:55.708209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2a6e0d88-8bb6-4633-8640-64e38564dbd4 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:55.709203 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2a6e0d88-8bb6-4633-8640-64e38564dbd4 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:55.720951 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2a6e0d88-8bb6-4633-8640-64e38564dbd4 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:55.722083 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2a6e0d88-8bb6-4633-8640-64e38564dbd4 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:55.723509 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2a6e0d88-8bb6-4633-8640-64e38564dbd4 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:55.724300 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2a6e0d88-8bb6-4633-8640-64e38564dbd4 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:55.822680 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-72abd787-91df-401f-b340-9036755d178b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:55.825089 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-72abd787-91df-401f-b340-9036755d178b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:55.834896 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-72abd787-91df-401f-b340-9036755d178b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:55.835948 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-72abd787-91df-401f-b340-9036755d178b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:55.837026 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-72abd787-91df-401f-b340-9036755d178b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:55.837740 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-72abd787-91df-401f-b340-9036755d178b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:56.006007 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-72abd787-91df-401f-b340-9036755d178b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:56.019591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-72abd787-91df-401f-b340-9036755d178b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:56.021482 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-72abd787-91df-401f-b340-9036755d178b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:56.022583 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-72abd787-91df-401f-b340-9036755d178b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1333 microversion: 2.20 time: 0.204381 Dec 16 14:43:56.034109 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 345/675] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:55 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1333 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:43:56.164154 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2a6e0d88-8bb6-4633-8640-64e38564dbd4 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:56.176540 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2a6e0d88-8bb6-4633-8640-64e38564dbd4 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1471 microversion: 2.1 time: 0.472033 Dec 16 14:43:56.181159 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 331/676] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:55 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:56.918765 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-29265c29-75fc-4ee5-8284-3da0871414ed req-36a7a33a-1115-42b4-956a-60b92942369b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65981206-fc07-4d04-b940-1718b46f008f", "name": "network-vif-deleted", "tag": "641e8b5b-c459-4be8-80b9-1e51a5562e77"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:56.921183 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:56.921183 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:43:56.963368 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-29265c29-75fc-4ee5-8284-3da0871414ed req-36a7a33a-1115-42b4-956a-60b92942369b service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:56.963873 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-29265c29-75fc-4ee5-8284-3da0871414ed req-36a7a33a-1115-42b4-956a-60b92942369b service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:57.023178 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-29265c29-75fc-4ee5-8284-3da0871414ed req-36a7a33a-1115-42b4-956a-60b92942369b service nova] Creating event network-vif-deleted:641e8b5b-c459-4be8-80b9-1e51a5562e77 for instance 65981206-fc07-4d04-b940-1718b46f008f on hv-cinder-82189 Dec 16 14:43:57.028391 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-29265c29-75fc-4ee5-8284-3da0871414ed req-36a7a33a-1115-42b4-956a-60b92942369b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113379 Dec 16 14:43:57.029835 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 346/677] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:57.045415 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c86b531e-5056-4afb-9b11-317e43176bb8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:57.046224 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c86b531e-5056-4afb-9b11-317e43176bb8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:57.066729 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c86b531e-5056-4afb-9b11-317e43176bb8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:57.067296 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c86b531e-5056-4afb-9b11-317e43176bb8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:57.068211 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c86b531e-5056-4afb-9b11-317e43176bb8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:57.068746 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c86b531e-5056-4afb-9b11-317e43176bb8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:57.198554 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:57.199922 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:57.213716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:57.216555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:57.217989 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:57.218436 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:57.324429 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:57.325080 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:57.325835 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lazy-loading 'fault' on Instance uuid 65981206-fc07-4d04-b940-1718b46f008f {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:43:57.549079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6995638c134e74b541bf0cbb929449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed21a1e88bf46c49beba44b174b57dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:57.555822 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c86b531e-5056-4afb-9b11-317e43176bb8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:57.564446 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5bc6320f-621c-4a02-a5b4-da52c7ac2add tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 200 len: 1305 microversion: 2.1 time: 0.370411 Dec 16 14:43:57.566951 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 347/678] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:57 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 1305 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:43:57.578277 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c86b531e-5056-4afb-9b11-317e43176bb8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:57.580024 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c86b531e-5056-4afb-9b11-317e43176bb8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:57.581392 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c86b531e-5056-4afb-9b11-317e43176bb8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1407 microversion: 2.20 time: 0.542119 Dec 16 14:43:57.593361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 332/679] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:57 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:43:58.289613 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-9d6653c5-3963-4b50-ab44-2cc52ae22e42 req-1e9a4aaa-629b-4c71-af05-80bc21f0e7be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5526fc-135b-4e73-882b-e446f2905447", "tag": "863ee071-cd68-4318-b951-baa44727d00f"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:43:58.292295 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:43:58.292295 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:43:58.304015 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-9d6653c5-3963-4b50-ab44-2cc52ae22e42 req-1e9a4aaa-629b-4c71-af05-80bc21f0e7be service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:58.304516 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-9d6653c5-3963-4b50-ab44-2cc52ae22e42 req-1e9a4aaa-629b-4c71-af05-80bc21f0e7be service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:58.326782 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-9d6653c5-3963-4b50-ab44-2cc52ae22e42 req-1e9a4aaa-629b-4c71-af05-80bc21f0e7be service nova] Creating event network-changed:863ee071-cd68-4318-b951-baa44727d00f for instance aa5526fc-135b-4e73-882b-e446f2905447 on hv-cinder-82189 Dec 16 14:43:58.333082 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-9d6653c5-3963-4b50-ab44-2cc52ae22e42 req-1e9a4aaa-629b-4c71-af05-80bc21f0e7be service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051549 Dec 16 14:43:58.333923 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 348/680] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:43:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:43:58.583015 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6373000d-2526-4fee-b60f-0d27d9fc58d9 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:58.583675 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6373000d-2526-4fee-b60f-0d27d9fc58d9 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] [instance: 65981206-fc07-4d04-b940-1718b46f008f] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:58.590869 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6373000d-2526-4fee-b60f-0d27d9fc58d9 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:58.591338 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6373000d-2526-4fee-b60f-0d27d9fc58d9 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:58.592115 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6373000d-2526-4fee-b60f-0d27d9fc58d9 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:58.592546 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6373000d-2526-4fee-b60f-0d27d9fc58d9 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:58.600191 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-6c3986c5-7bed-45c4-9217-1214154daee1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:58.601190 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-6c3986c5-7bed-45c4-9217-1214154daee1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:58.608694 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6c3986c5-7bed-45c4-9217-1214154daee1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:58.609175 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6c3986c5-7bed-45c4-9217-1214154daee1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:58.610318 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6c3986c5-7bed-45c4-9217-1214154daee1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:58.610751 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6c3986c5-7bed-45c4-9217-1214154daee1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:58.649347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-6373000d-2526-4fee-b60f-0d27d9fc58d9 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] HTTP exception thrown: Instance 65981206-fc07-4d04-b940-1718b46f008f could not be found. Dec 16 14:43:58.649950 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6373000d-2526-4fee-b60f-0d27d9fc58d9 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] Returning 404 to user: Instance 65981206-fc07-4d04-b940-1718b46f008f could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:43:58.651120 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6373000d-2526-4fee-b60f-0d27d9fc58d9 tempest-VolumesNegativeTest-2006659421 tempest-VolumesNegativeTest-2006659421-project] 10.222.0.64 "GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f" status: 404 len: 111 microversion: 2.1 time: 0.071847 Dec 16 14:43:58.651991 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 333/681] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:43:58 2021] GET /compute/v2.1/servers/65981206-fc07-4d04-b940-1718b46f008f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:43:58.883715 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6c3986c5-7bed-45c4-9217-1214154daee1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:58.901381 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6c3986c5-7bed-45c4-9217-1214154daee1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:58.903345 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6c3986c5-7bed-45c4-9217-1214154daee1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:43:58.904690 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-6c3986c5-7bed-45c4-9217-1214154daee1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1407 microversion: 2.20 time: 0.309005 Dec 16 14:43:58.916650 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 349/682] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:58 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:43:59.923267 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-58a77120-da8a-4036-9c27-b31caaef9c53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:43:59.924603 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-58a77120-da8a-4036-9c27-b31caaef9c53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:43:59.933143 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-58a77120-da8a-4036-9c27-b31caaef9c53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:59.933662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-58a77120-da8a-4036-9c27-b31caaef9c53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:43:59.934947 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-58a77120-da8a-4036-9c27-b31caaef9c53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:43:59.935406 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-58a77120-da8a-4036-9c27-b31caaef9c53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:00.159099 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-58a77120-da8a-4036-9c27-b31caaef9c53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:00.169497 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-58a77120-da8a-4036-9c27-b31caaef9c53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:00.171275 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-58a77120-da8a-4036-9c27-b31caaef9c53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:00.172547 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-58a77120-da8a-4036-9c27-b31caaef9c53 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1407 microversion: 2.20 time: 0.253024 Dec 16 14:44:00.173922 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 334/683] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:43:59 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:44:01.190296 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3db7ca1d-18b1-4070-97c4-9b4ee32ca68a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:01.190957 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3db7ca1d-18b1-4070-97c4-9b4ee32ca68a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:01.198154 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3db7ca1d-18b1-4070-97c4-9b4ee32ca68a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:01.198612 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3db7ca1d-18b1-4070-97c4-9b4ee32ca68a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:01.199885 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3db7ca1d-18b1-4070-97c4-9b4ee32ca68a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:01.200325 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3db7ca1d-18b1-4070-97c4-9b4ee32ca68a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:01.404624 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3db7ca1d-18b1-4070-97c4-9b4ee32ca68a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:01.413420 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3db7ca1d-18b1-4070-97c4-9b4ee32ca68a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:01.415294 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3db7ca1d-18b1-4070-97c4-9b4ee32ca68a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:01.416010 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3db7ca1d-18b1-4070-97c4-9b4ee32ca68a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1407 microversion: 2.20 time: 0.229503 Dec 16 14:44:01.416552 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 350/684] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:44:01 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:44:02.433845 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-677754d0-7649-413d-a789-5459c1642625 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:02.434662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-677754d0-7649-413d-a789-5459c1642625 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:02.441671 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-677754d0-7649-413d-a789-5459c1642625 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:02.442117 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-677754d0-7649-413d-a789-5459c1642625 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:02.442879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-677754d0-7649-413d-a789-5459c1642625 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:02.443312 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-677754d0-7649-413d-a789-5459c1642625 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:02.643408 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-677754d0-7649-413d-a789-5459c1642625 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:02.653162 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-677754d0-7649-413d-a789-5459c1642625 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:02.654684 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-677754d0-7649-413d-a789-5459c1642625 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:02.655754 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-677754d0-7649-413d-a789-5459c1642625 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1407 microversion: 2.20 time: 0.225686 Dec 16 14:44:02.656287 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 335/685] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:44:02 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:44:03.672750 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-00377f05-b66a-4428-991e-4e9dd34fe265 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:03.673361 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-00377f05-b66a-4428-991e-4e9dd34fe265 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:03.680757 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-00377f05-b66a-4428-991e-4e9dd34fe265 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:03.681234 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-00377f05-b66a-4428-991e-4e9dd34fe265 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:03.682005 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-00377f05-b66a-4428-991e-4e9dd34fe265 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:03.682436 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-00377f05-b66a-4428-991e-4e9dd34fe265 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:03.878973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-00377f05-b66a-4428-991e-4e9dd34fe265 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:03.888547 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-00377f05-b66a-4428-991e-4e9dd34fe265 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:03.890081 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-00377f05-b66a-4428-991e-4e9dd34fe265 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:03.891153 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-00377f05-b66a-4428-991e-4e9dd34fe265 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1407 microversion: 2.20 time: 0.222213 Dec 16 14:44:03.891723 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 351/686] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:44:03 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:44:04.908970 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-52806e56-d125-4d24-9f06-316c5cfa8353 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:04.909577 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-52806e56-d125-4d24-9f06-316c5cfa8353 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:04.916815 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-52806e56-d125-4d24-9f06-316c5cfa8353 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:04.917256 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-52806e56-d125-4d24-9f06-316c5cfa8353 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:04.918020 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-52806e56-d125-4d24-9f06-316c5cfa8353 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:04.918449 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-52806e56-d125-4d24-9f06-316c5cfa8353 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:05.108496 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-52806e56-d125-4d24-9f06-316c5cfa8353 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:05.119338 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-52806e56-d125-4d24-9f06-316c5cfa8353 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:05.121441 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-52806e56-d125-4d24-9f06-316c5cfa8353 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:05.122514 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-52806e56-d125-4d24-9f06-316c5cfa8353 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1407 microversion: 2.20 time: 0.217333 Dec 16 14:44:05.123071 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 336/687] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:44:04 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:44:06.141110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-27d1d346-078f-4298-be7c-0d4139ed0fc6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:06.141660 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-27d1d346-078f-4298-be7c-0d4139ed0fc6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:06.144919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d989187-3e87-46c2-8fd9-84acac2d774c] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 14:44:06.149764 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-27d1d346-078f-4298-be7c-0d4139ed0fc6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:06.150201 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-27d1d346-078f-4298-be7c-0d4139ed0fc6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:06.150955 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-27d1d346-078f-4298-be7c-0d4139ed0fc6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:06.151378 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-27d1d346-078f-4298-be7c-0d4139ed0fc6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:06.356447 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-27d1d346-078f-4298-be7c-0d4139ed0fc6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:06.366234 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-27d1d346-078f-4298-be7c-0d4139ed0fc6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:06.367589 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-27d1d346-078f-4298-be7c-0d4139ed0fc6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:06.368676 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-27d1d346-078f-4298-be7c-0d4139ed0fc6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1407 microversion: 2.20 time: 0.232001 Dec 16 14:44:06.369253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 352/688] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:44:06 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:44:07.365347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-62757c70-fa9b-4c89-ab59-b8b929cd00d6 req-87ca1632-12dd-4bd6-829f-c3dfc424a764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5526fc-135b-4e73-882b-e446f2905447", "name": "network-vif-plugged", "status": "completed", "tag": "863ee071-cd68-4318-b951-baa44727d00f"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:07.367666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:44:07.367666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:44:07.375628 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-62757c70-fa9b-4c89-ab59-b8b929cd00d6 req-87ca1632-12dd-4bd6-829f-c3dfc424a764 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:07.376251 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-62757c70-fa9b-4c89-ab59-b8b929cd00d6 req-87ca1632-12dd-4bd6-829f-c3dfc424a764 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:07.388411 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-983a993f-ee80-4d70-a604-6150c1541312 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:07.389785 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-983a993f-ee80-4d70-a604-6150c1541312 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:07.393419 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-62757c70-fa9b-4c89-ab59-b8b929cd00d6 req-87ca1632-12dd-4bd6-829f-c3dfc424a764 service nova] Creating event network-vif-plugged:863ee071-cd68-4318-b951-baa44727d00f for instance aa5526fc-135b-4e73-882b-e446f2905447 on hv-cinder-82189 Dec 16 14:44:07.398343 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-62757c70-fa9b-4c89-ab59-b8b929cd00d6 req-87ca1632-12dd-4bd6-829f-c3dfc424a764 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036919 Dec 16 14:44:07.399319 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 337/689] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:44:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:44:07.414400 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-983a993f-ee80-4d70-a604-6150c1541312 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:07.414854 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-983a993f-ee80-4d70-a604-6150c1541312 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:07.415633 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-983a993f-ee80-4d70-a604-6150c1541312 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:07.416390 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-983a993f-ee80-4d70-a604-6150c1541312 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:07.425030 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d989187-3e87-46c2-8fd9-84acac2d774c] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 55276. Dec 16 14:44:07.653565 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-983a993f-ee80-4d70-a604-6150c1541312 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:07.665209 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-983a993f-ee80-4d70-a604-6150c1541312 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:07.667226 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-983a993f-ee80-4d70-a604-6150c1541312 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:07.670154 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-983a993f-ee80-4d70-a604-6150c1541312 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1407 microversion: 2.20 time: 0.287142 Dec 16 14:44:07.671466 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 353/690] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:44:07 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:44:08.689448 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c8a1d2bd-7a18-472d-8d7e-e4cd6300693f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:08.690728 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c8a1d2bd-7a18-472d-8d7e-e4cd6300693f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:08.698641 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8a1d2bd-7a18-472d-8d7e-e4cd6300693f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:08.699592 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8a1d2bd-7a18-472d-8d7e-e4cd6300693f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:08.700739 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8a1d2bd-7a18-472d-8d7e-e4cd6300693f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:08.701361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c8a1d2bd-7a18-472d-8d7e-e4cd6300693f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:09.019842 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c8a1d2bd-7a18-472d-8d7e-e4cd6300693f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:09.033094 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c8a1d2bd-7a18-472d-8d7e-e4cd6300693f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:09.035535 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c8a1d2bd-7a18-472d-8d7e-e4cd6300693f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:09.037133 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c8a1d2bd-7a18-472d-8d7e-e4cd6300693f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1407 microversion: 2.20 time: 0.351872 Dec 16 14:44:09.038010 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 338/691] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:44:08 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:44:10.055327 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5de8c299-4ed0-47d1-a96c-82264f5eac4c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:10.057071 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5de8c299-4ed0-47d1-a96c-82264f5eac4c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:10.081537 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5de8c299-4ed0-47d1-a96c-82264f5eac4c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:10.082313 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5de8c299-4ed0-47d1-a96c-82264f5eac4c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:10.083451 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5de8c299-4ed0-47d1-a96c-82264f5eac4c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:10.084044 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5de8c299-4ed0-47d1-a96c-82264f5eac4c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:10.340506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5de8c299-4ed0-47d1-a96c-82264f5eac4c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:10.353304 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5de8c299-4ed0-47d1-a96c-82264f5eac4c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:10.354943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5de8c299-4ed0-47d1-a96c-82264f5eac4c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:10.356537 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5de8c299-4ed0-47d1-a96c-82264f5eac4c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1599 microversion: 2.20 time: 0.304976 Dec 16 14:44:10.365088 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 354/692] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:44:10 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1599 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:44:10.373755 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-edd41c7d-4f02-438b-acd6-9ae45c14bdae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:10.374246 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-edd41c7d-4f02-438b-acd6-9ae45c14bdae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:10.384703 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-edd41c7d-4f02-438b-acd6-9ae45c14bdae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:10.385203 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-edd41c7d-4f02-438b-acd6-9ae45c14bdae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:10.390949 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-edd41c7d-4f02-438b-acd6-9ae45c14bdae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:10.391428 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-edd41c7d-4f02-438b-acd6-9ae45c14bdae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:10.644484 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-edd41c7d-4f02-438b-acd6-9ae45c14bdae tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.274584 Dec 16 14:44:10.645143 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 339/693] 10.222.0.64 () {60 vars in 1315 bytes} [Thu Dec 16 14:44:10 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:44:13.487532 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f56b1625-4dbe-4b17-8b58-79638431c01e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:13.488605 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f56b1625-4dbe-4b17-8b58-79638431c01e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:13.496214 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-2c34e189-9372-42b3-bd22-978d13e4a035 req-0ab8ea50-e97a-432e-8be8-9cd3126a4e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5526fc-135b-4e73-882b-e446f2905447", "tag": "863ee071-cd68-4318-b951-baa44727d00f"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:13.497806 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:44:13.497806 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:44:13.507221 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f56b1625-4dbe-4b17-8b58-79638431c01e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:13.507873 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f56b1625-4dbe-4b17-8b58-79638431c01e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:13.508948 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f56b1625-4dbe-4b17-8b58-79638431c01e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:13.509642 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-2c34e189-9372-42b3-bd22-978d13e4a035 req-0ab8ea50-e97a-432e-8be8-9cd3126a4e06 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:13.509895 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f56b1625-4dbe-4b17-8b58-79638431c01e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:13.512223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-2c34e189-9372-42b3-bd22-978d13e4a035 req-0ab8ea50-e97a-432e-8be8-9cd3126a4e06 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:13.544838 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-2c34e189-9372-42b3-bd22-978d13e4a035 req-0ab8ea50-e97a-432e-8be8-9cd3126a4e06 service nova] Creating event network-changed:863ee071-cd68-4318-b951-baa44727d00f for instance aa5526fc-135b-4e73-882b-e446f2905447 on hv-cinder-82189 Dec 16 14:44:13.561434 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-2c34e189-9372-42b3-bd22-978d13e4a035 req-0ab8ea50-e97a-432e-8be8-9cd3126a4e06 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066029 Dec 16 14:44:13.562344 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 340/694] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:44:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:44:13.688053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f56b1625-4dbe-4b17-8b58-79638431c01e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 14 microversion: 2.20 time: 0.203991 Dec 16 14:44:13.688692 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 355/695] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:13 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 14 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:14.701482 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d73d6c53-ef04-4daf-8e36-81e7466d2acd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:14.703650 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d73d6c53-ef04-4daf-8e36-81e7466d2acd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:14.712498 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d73d6c53-ef04-4daf-8e36-81e7466d2acd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:14.714083 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d73d6c53-ef04-4daf-8e36-81e7466d2acd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:14.715772 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d73d6c53-ef04-4daf-8e36-81e7466d2acd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:14.716444 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d73d6c53-ef04-4daf-8e36-81e7466d2acd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:14.880931 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d73d6c53-ef04-4daf-8e36-81e7466d2acd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 14 microversion: 2.20 time: 0.183826 Dec 16 14:44:14.883991 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 341/696] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:14 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:15.892428 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-827ae4f6-7b0f-4f0d-95ae-cc124f72e1f3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:15.893447 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-827ae4f6-7b0f-4f0d-95ae-cc124f72e1f3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:15.914699 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-827ae4f6-7b0f-4f0d-95ae-cc124f72e1f3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:15.915405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-827ae4f6-7b0f-4f0d-95ae-cc124f72e1f3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:15.916233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-827ae4f6-7b0f-4f0d-95ae-cc124f72e1f3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:15.916667 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-827ae4f6-7b0f-4f0d-95ae-cc124f72e1f3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:16.133857 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-827ae4f6-7b0f-4f0d-95ae-cc124f72e1f3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 14 microversion: 2.20 time: 0.245261 Dec 16 14:44:16.134943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 356/697] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:15 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 14 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:17.151001 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-443235c2-2d50-4a10-a27f-107028c8b799 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:17.153430 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-443235c2-2d50-4a10-a27f-107028c8b799 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:17.178188 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-443235c2-2d50-4a10-a27f-107028c8b799 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:17.178658 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-443235c2-2d50-4a10-a27f-107028c8b799 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:17.179470 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-443235c2-2d50-4a10-a27f-107028c8b799 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:17.179905 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-443235c2-2d50-4a10-a27f-107028c8b799 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:17.381116 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-443235c2-2d50-4a10-a27f-107028c8b799 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 14 microversion: 2.20 time: 0.238818 Dec 16 14:44:17.384869 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 342/698] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:17 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 14 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:18.392422 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3ae229a6-cbc2-452d-bb11-08d91254d61e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:18.394060 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3ae229a6-cbc2-452d-bb11-08d91254d61e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:18.402757 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ae229a6-cbc2-452d-bb11-08d91254d61e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:18.403676 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ae229a6-cbc2-452d-bb11-08d91254d61e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:18.404829 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ae229a6-cbc2-452d-bb11-08d91254d61e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:18.405418 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3ae229a6-cbc2-452d-bb11-08d91254d61e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:20.555350 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3ae229a6-cbc2-452d-bb11-08d91254d61e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 14 microversion: 2.20 time: 2.165239 Dec 16 14:44:20.563127 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 357/699] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:18 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 14 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:21.570272 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ac0b4c43-5d12-466a-b5bb-522185f333d2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:21.571282 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ac0b4c43-5d12-466a-b5bb-522185f333d2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:21.587099 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ac0b4c43-5d12-466a-b5bb-522185f333d2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:21.587560 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ac0b4c43-5d12-466a-b5bb-522185f333d2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:21.588354 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ac0b4c43-5d12-466a-b5bb-522185f333d2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:21.600488 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ac0b4c43-5d12-466a-b5bb-522185f333d2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:23.594418 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ac0b4c43-5d12-466a-b5bb-522185f333d2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 16196 microversion: 2.20 time: 2.028218 Dec 16 14:44:23.603529 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 343/700] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:21 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 16196 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:24.630655 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e6b4772c-71f8-4189-905b-150496c98bad tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:24.634140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e6b4772c-71f8-4189-905b-150496c98bad tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:24.654778 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6b4772c-71f8-4189-905b-150496c98bad tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:24.655190 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6b4772c-71f8-4189-905b-150496c98bad tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:24.655989 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6b4772c-71f8-4189-905b-150496c98bad tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:24.656418 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6b4772c-71f8-4189-905b-150496c98bad tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:24.846623 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e6b4772c-71f8-4189-905b-150496c98bad tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 18498 microversion: 2.20 time: 0.236124 Dec 16 14:44:24.847931 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 358/701] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:24 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 18498 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:25.858640 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e7eda201-e60d-4605-9f95-6423d6ab6ba8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:25.859645 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e7eda201-e60d-4605-9f95-6423d6ab6ba8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:25.883214 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e7eda201-e60d-4605-9f95-6423d6ab6ba8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:25.886531 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e7eda201-e60d-4605-9f95-6423d6ab6ba8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:25.887641 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e7eda201-e60d-4605-9f95-6423d6ab6ba8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:25.889531 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e7eda201-e60d-4605-9f95-6423d6ab6ba8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:26.149361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e7eda201-e60d-4605-9f95-6423d6ab6ba8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 21935 microversion: 2.20 time: 0.294623 Dec 16 14:44:26.150487 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 344/702] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:25 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 21935 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:44:27.161961 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-34c49656-aeb0-47e6-9914-889093aaf097 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:27.162977 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-34c49656-aeb0-47e6-9914-889093aaf097 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:27.172979 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34c49656-aeb0-47e6-9914-889093aaf097 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:27.173849 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34c49656-aeb0-47e6-9914-889093aaf097 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:27.174800 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34c49656-aeb0-47e6-9914-889093aaf097 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:27.178381 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34c49656-aeb0-47e6-9914-889093aaf097 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:27.348164 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-34c49656-aeb0-47e6-9914-889093aaf097 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 23235 microversion: 2.20 time: 0.191017 Dec 16 14:44:27.348966 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 359/703] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:27 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 23235 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:28.360389 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-37c8c60d-291a-45f5-8bd4-6f6f88fffbb7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:28.361637 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-37c8c60d-291a-45f5-8bd4-6f6f88fffbb7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:28.382838 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-37c8c60d-291a-45f5-8bd4-6f6f88fffbb7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:28.395173 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-37c8c60d-291a-45f5-8bd4-6f6f88fffbb7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:28.396051 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-37c8c60d-291a-45f5-8bd4-6f6f88fffbb7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:28.396503 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-37c8c60d-291a-45f5-8bd4-6f6f88fffbb7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:28.679393 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-37c8c60d-291a-45f5-8bd4-6f6f88fffbb7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 24975 microversion: 2.20 time: 0.322916 Dec 16 14:44:28.684904 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 345/704] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:28 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 24975 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:29.695876 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e81751d7-8bc9-47c2-b9ef-cc053ab01f0f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:29.696945 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e81751d7-8bc9-47c2-b9ef-cc053ab01f0f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:29.718481 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e81751d7-8bc9-47c2-b9ef-cc053ab01f0f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:29.719095 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e81751d7-8bc9-47c2-b9ef-cc053ab01f0f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:29.720880 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e81751d7-8bc9-47c2-b9ef-cc053ab01f0f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:29.721520 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e81751d7-8bc9-47c2-b9ef-cc053ab01f0f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:29.873785 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e81751d7-8bc9-47c2-b9ef-cc053ab01f0f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 26760 microversion: 2.20 time: 0.185063 Dec 16 14:44:29.875412 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 360/705] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:29 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 26760 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:30.894654 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-52fe8a15-646d-401c-9888-bdd595ac453e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:30.895701 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-52fe8a15-646d-401c-9888-bdd595ac453e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:30.924823 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-52fe8a15-646d-401c-9888-bdd595ac453e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:30.930056 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-52fe8a15-646d-401c-9888-bdd595ac453e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:30.930929 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-52fe8a15-646d-401c-9888-bdd595ac453e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:30.931371 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-52fe8a15-646d-401c-9888-bdd595ac453e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:31.187992 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-52fe8a15-646d-401c-9888-bdd595ac453e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 27762 microversion: 2.20 time: 0.305599 Dec 16 14:44:31.194733 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 346/706] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:30 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 27762 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:31.669778 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4ff20086-9ed1-4e8f-a4cc-cdff724e75ae tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Action: 'create', calling method: .version_select at 0x7f3c2c6758b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-900255515"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:31.709000 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-4ff20086-9ed1-4e8f-a4cc-cdff724e75ae tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Getting quotas for project 46480af5f9db43618ad0897695518251. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:44:31.714137 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-4ff20086-9ed1-4e8f-a4cc-cdff724e75ae tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Getting quotas for user c00d30670c444605a25d63560d82fcbf and project 46480af5f9db43618ad0897695518251. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:44:32.211683 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9eea9226-77f8-45e2-85ca-373cb8f6de81 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:32.213766 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9eea9226-77f8-45e2-85ca-373cb8f6de81 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:32.242869 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9eea9226-77f8-45e2-85ca-373cb8f6de81 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:32.243852 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9eea9226-77f8-45e2-85ca-373cb8f6de81 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:32.246385 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9eea9226-77f8-45e2-85ca-373cb8f6de81 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:32.247000 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9eea9226-77f8-45e2-85ca-373cb8f6de81 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:32.295437 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-4ff20086-9ed1-4e8f-a4cc-cdff724e75ae tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Getting quotas for project 46480af5f9db43618ad0897695518251. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:44:32.305008 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-4ff20086-9ed1-4e8f-a4cc-cdff724e75ae tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Getting quotas for user c00d30670c444605a25d63560d82fcbf and project 46480af5f9db43618ad0897695518251. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:44:32.336915 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4ff20086-9ed1-4e8f-a4cc-cdff724e75ae tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 1.007736 Dec 16 14:44:32.338260 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 361/707] 10.222.0.64 () {60 vars in 1157 bytes} [Thu Dec 16 14:44:31 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:44:32.427202 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9eea9226-77f8-45e2-85ca-373cb8f6de81 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 28242 microversion: 2.20 time: 0.229210 Dec 16 14:44:32.434006 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 347/708] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:32 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 28242 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:33.706660 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bc051bba-bc5f-4360-a64e-5078d49e4678 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:33.708283 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bc051bba-bc5f-4360-a64e-5078d49e4678 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:33.722957 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc051bba-bc5f-4360-a64e-5078d49e4678 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:33.723746 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc051bba-bc5f-4360-a64e-5078d49e4678 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:33.724699 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc051bba-bc5f-4360-a64e-5078d49e4678 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:33.726563 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc051bba-bc5f-4360-a64e-5078d49e4678 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:35.588021 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bc051bba-bc5f-4360-a64e-5078d49e4678 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 28242 microversion: 2.20 time: 2.150575 Dec 16 14:44:35.591957 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 362/709] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:33 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 28242 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:36.600684 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-cfe1b7cf-f264-4036-b754-43d68798ef44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:36.601874 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-cfe1b7cf-f264-4036-b754-43d68798ef44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:36.622593 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cfe1b7cf-f264-4036-b754-43d68798ef44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:36.637217 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cfe1b7cf-f264-4036-b754-43d68798ef44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:36.638308 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cfe1b7cf-f264-4036-b754-43d68798ef44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:36.638831 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cfe1b7cf-f264-4036-b754-43d68798ef44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:36.793636 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-cfe1b7cf-f264-4036-b754-43d68798ef44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 28242 microversion: 2.20 time: 0.197301 Dec 16 14:44:36.794403 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 348/710] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:36 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 28242 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:37.808449 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fb469514-e67a-4643-9a59-ee810b3d4c96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:37.809569 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fb469514-e67a-4643-9a59-ee810b3d4c96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:37.823585 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb469514-e67a-4643-9a59-ee810b3d4c96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:37.825471 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb469514-e67a-4643-9a59-ee810b3d4c96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:37.828402 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb469514-e67a-4643-9a59-ee810b3d4c96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:37.829871 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb469514-e67a-4643-9a59-ee810b3d4c96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:37.985873 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fb469514-e67a-4643-9a59-ee810b3d4c96 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 28533 microversion: 2.20 time: 0.182726 Dec 16 14:44:37.987555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 363/711] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:37 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 28533 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:39.013640 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4e856f68-83fa-4971-bd71-3b424ce127b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:39.015194 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4e856f68-83fa-4971-bd71-3b424ce127b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:39.023433 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e856f68-83fa-4971-bd71-3b424ce127b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:39.023889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e856f68-83fa-4971-bd71-3b424ce127b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:39.024662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e856f68-83fa-4971-bd71-3b424ce127b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:39.025187 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4e856f68-83fa-4971-bd71-3b424ce127b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:39.155609 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4e856f68-83fa-4971-bd71-3b424ce127b1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 28701 microversion: 2.20 time: 0.159602 Dec 16 14:44:39.156509 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 349/712] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:38 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 28701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:40.169852 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8b7e4acf-ca55-4042-a1e8-d7080bcbc1dd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:40.170961 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8b7e4acf-ca55-4042-a1e8-d7080bcbc1dd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:40.194830 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b7e4acf-ca55-4042-a1e8-d7080bcbc1dd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:40.195554 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b7e4acf-ca55-4042-a1e8-d7080bcbc1dd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:40.196465 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b7e4acf-ca55-4042-a1e8-d7080bcbc1dd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:40.197591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8b7e4acf-ca55-4042-a1e8-d7080bcbc1dd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:40.375233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8b7e4acf-ca55-4042-a1e8-d7080bcbc1dd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 28701 microversion: 2.20 time: 0.210025 Dec 16 14:44:40.376440 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 364/713] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:40 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 28701 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:41.418658 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-eb4c874a-a421-4199-ac8f-fba29e633d44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:41.420223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-eb4c874a-a421-4199-ac8f-fba29e633d44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:41.429984 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb4c874a-a421-4199-ac8f-fba29e633d44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:41.430669 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb4c874a-a421-4199-ac8f-fba29e633d44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:41.432717 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb4c874a-a421-4199-ac8f-fba29e633d44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:41.433625 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb4c874a-a421-4199-ac8f-fba29e633d44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:41.563917 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a591ae0a-51f9-458b-b174-c829715233d1 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Action: 'create', calling method: .version_select at 0x7f3c2c2f8040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1816150922"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:41.573231 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-eb4c874a-a421-4199-ac8f-fba29e633d44 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 28701 microversion: 2.20 time: 0.159772 Dec 16 14:44:41.574536 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 350/714] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:41 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 28701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:41.590646 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-a591ae0a-51f9-458b-b174-c829715233d1 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Getting quotas for project 90b1e0c2f8144613a8e65e6b0e208a87. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:44:41.595392 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-a591ae0a-51f9-458b-b174-c829715233d1 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Getting quotas for user c993a63eecd0427bb688f1fd6d435168 and project 90b1e0c2f8144613a8e65e6b0e208a87. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:44:41.847466 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-a591ae0a-51f9-458b-b174-c829715233d1 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Getting quotas for project 90b1e0c2f8144613a8e65e6b0e208a87. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:44:41.853075 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-a591ae0a-51f9-458b-b174-c829715233d1 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Getting quotas for user c993a63eecd0427bb688f1fd6d435168 and project 90b1e0c2f8144613a8e65e6b0e208a87. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:44:41.869572 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a591ae0a-51f9-458b-b174-c829715233d1 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.310308 Dec 16 14:44:41.870568 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 365/715] 10.222.0.64 () {60 vars in 1157 bytes} [Thu Dec 16 14:44:41 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:42.042651 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-597196112", "imageRef": "84d86510-91f5-413d-a5dc-478a98ad1274", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1816150922", "networks": [{"uuid": "bb27a73b-c5ab-4802-a8a2-f712426550d4"}]}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:42.363606 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] validate_networks() for [('bb27a73b-c5ab-4802-a8a2-f712426550d4', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:44:42.587549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e92ffd8c-d87f-4196-9041-db0af9e0ff28 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:42.589038 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e92ffd8c-d87f-4196-9041-db0af9e0ff28 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:42.601087 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e92ffd8c-d87f-4196-9041-db0af9e0ff28 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:42.601716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e92ffd8c-d87f-4196-9041-db0af9e0ff28 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:42.602828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e92ffd8c-d87f-4196-9041-db0af9e0ff28 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:42.603469 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e92ffd8c-d87f-4196-9041-db0af9e0ff28 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:42.745337 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e92ffd8c-d87f-4196-9041-db0af9e0ff28 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 28726 microversion: 2.20 time: 0.163445 Dec 16 14:44:42.746092 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 366/716] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:42 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 28726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:44:43.175670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:44:43.176138 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:44:43.176612 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:44:43.177079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:44:43.177493 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:44:43.186380 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:43.186832 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:43.187637 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:43.188073 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:43.205599 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Getting quotas for project 90b1e0c2f8144613a8e65e6b0e208a87. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:44:43.209739 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Getting quotas for user c993a63eecd0427bb688f1fd6d435168 and project 90b1e0c2f8144613a8e65e6b0e208a87. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:44:43.220667 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:44:43.223113 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84d86510-91f5-413d-a5dc-478a98ad1274',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:44:43.271132 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-cc0e42fe-ec57-4cf2-8403-c048bd6b5472 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232752 Dec 16 14:44:43.271680 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 351/717] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:44:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:44:43.283465 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-90bf9e31-4ec1-4bec-beda-8a912ff51496 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:43.284194 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-90bf9e31-4ec1-4bec-beda-8a912ff51496 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:43.676163 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-90bf9e31-4ec1-4bec-beda-8a912ff51496 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:43.683882 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-90bf9e31-4ec1-4bec-beda-8a912ff51496 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1258 microversion: 2.1 time: 0.405239 Dec 16 14:44:43.684428 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 367/718] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:43 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1258 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:43.761112 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e0525707-29ad-4d41-8a4b-261cd89081fd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:43.762300 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e0525707-29ad-4d41-8a4b-261cd89081fd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:43.771853 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e0525707-29ad-4d41-8a4b-261cd89081fd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:43.772805 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e0525707-29ad-4d41-8a4b-261cd89081fd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:43.774001 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e0525707-29ad-4d41-8a4b-261cd89081fd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:43.774294 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e0525707-29ad-4d41-8a4b-261cd89081fd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:43.934776 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e0525707-29ad-4d41-8a4b-261cd89081fd tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 30883 microversion: 2.20 time: 0.180411 Dec 16 14:44:43.935817 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 352/719] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:43 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 30883 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:44.700590 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7c70f8f7-c8ca-44d1-91a2-41030cf9856a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:44.701233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7c70f8f7-c8ca-44d1-91a2-41030cf9856a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:44.710107 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7c70f8f7-c8ca-44d1-91a2-41030cf9856a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:44.710555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7c70f8f7-c8ca-44d1-91a2-41030cf9856a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:44.711332 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7c70f8f7-c8ca-44d1-91a2-41030cf9856a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:44.711767 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7c70f8f7-c8ca-44d1-91a2-41030cf9856a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:44.828207 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7c70f8f7-c8ca-44d1-91a2-41030cf9856a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:44.851694 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7c70f8f7-c8ca-44d1-91a2-41030cf9856a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1310 microversion: 2.1 time: 0.151772 Dec 16 14:44:44.854092 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 368/720] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:44 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1310 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:44.947578 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9ef392bb-91af-4232-abf6-c54c2c26ed90 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:44.949195 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9ef392bb-91af-4232-abf6-c54c2c26ed90 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:44.963816 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9ef392bb-91af-4232-abf6-c54c2c26ed90 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:44.966023 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9ef392bb-91af-4232-abf6-c54c2c26ed90 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:44.966848 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9ef392bb-91af-4232-abf6-c54c2c26ed90 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:44.967291 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9ef392bb-91af-4232-abf6-c54c2c26ed90 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:45.129932 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9ef392bb-91af-4232-abf6-c54c2c26ed90 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 32313 microversion: 2.20 time: 0.184380 Dec 16 14:44:45.134302 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 353/721] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:44 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 32313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:44:45.871381 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1ae6d466-62cf-40c8-99bb-51d7636364f6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:45.872894 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1ae6d466-62cf-40c8-99bb-51d7636364f6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:45.889641 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1ae6d466-62cf-40c8-99bb-51d7636364f6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:45.890538 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1ae6d466-62cf-40c8-99bb-51d7636364f6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:45.892892 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1ae6d466-62cf-40c8-99bb-51d7636364f6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:45.893746 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1ae6d466-62cf-40c8-99bb-51d7636364f6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:46.146575 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d25b85b7-2771-41df-9d60-8113cf0df084 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:46.147631 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d25b85b7-2771-41df-9d60-8113cf0df084 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:46.161969 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d25b85b7-2771-41df-9d60-8113cf0df084 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:46.165567 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d25b85b7-2771-41df-9d60-8113cf0df084 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:46.169924 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d25b85b7-2771-41df-9d60-8113cf0df084 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:46.170562 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d25b85b7-2771-41df-9d60-8113cf0df084 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:46.436253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1ae6d466-62cf-40c8-99bb-51d7636364f6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:46.446316 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1ae6d466-62cf-40c8-99bb-51d7636364f6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.579567 Dec 16 14:44:46.447707 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 369/722] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:45 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:47.472006 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f27e825c-3a2e-4b73-bad6-c5c7d1525852 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:47.472006 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f27e825c-3a2e-4b73-bad6-c5c7d1525852 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:47.482514 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f27e825c-3a2e-4b73-bad6-c5c7d1525852 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:47.483431 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f27e825c-3a2e-4b73-bad6-c5c7d1525852 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:47.485168 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f27e825c-3a2e-4b73-bad6-c5c7d1525852 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:47.485870 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f27e825c-3a2e-4b73-bad6-c5c7d1525852 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:47.722619 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f27e825c-3a2e-4b73-bad6-c5c7d1525852 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:47.731974 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f27e825c-3a2e-4b73-bad6-c5c7d1525852 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.272016 Dec 16 14:44:47.732642 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 370/723] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:47 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:44:48.748576 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5a1a37d9-3f30-401e-9011-bb5aa7259533 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:48.749209 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5a1a37d9-3f30-401e-9011-bb5aa7259533 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:48.756681 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5a1a37d9-3f30-401e-9011-bb5aa7259533 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:48.757296 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5a1a37d9-3f30-401e-9011-bb5aa7259533 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:48.757912 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5a1a37d9-3f30-401e-9011-bb5aa7259533 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:48.758351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5a1a37d9-3f30-401e-9011-bb5aa7259533 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:48.982896 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5a1a37d9-3f30-401e-9011-bb5aa7259533 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:48.997901 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5a1a37d9-3f30-401e-9011-bb5aa7259533 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.252888 Dec 16 14:44:48.998730 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 371/724] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:48 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:44:50.017752 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3670669d-12b2-40af-90a9-72f30824031b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:50.018495 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3670669d-12b2-40af-90a9-72f30824031b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:50.040114 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3670669d-12b2-40af-90a9-72f30824031b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:50.040561 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3670669d-12b2-40af-90a9-72f30824031b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:50.045973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3670669d-12b2-40af-90a9-72f30824031b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:50.046426 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3670669d-12b2-40af-90a9-72f30824031b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:50.281028 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3670669d-12b2-40af-90a9-72f30824031b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:50.290580 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3670669d-12b2-40af-90a9-72f30824031b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.276491 Dec 16 14:44:50.291398 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 372/725] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:50 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:44:51.309879 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1eb52813-1346-4b47-85af-4a3c9dcd29f8 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:51.310882 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1eb52813-1346-4b47-85af-4a3c9dcd29f8 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:51.318746 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1eb52813-1346-4b47-85af-4a3c9dcd29f8 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:51.319635 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1eb52813-1346-4b47-85af-4a3c9dcd29f8 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:51.320575 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1eb52813-1346-4b47-85af-4a3c9dcd29f8 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:51.322413 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1eb52813-1346-4b47-85af-4a3c9dcd29f8 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:51.689778 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1eb52813-1346-4b47-85af-4a3c9dcd29f8 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:51.698455 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1eb52813-1346-4b47-85af-4a3c9dcd29f8 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.394724 Dec 16 14:44:51.699008 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 373/726] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:51 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:52.715731 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-965750d8-18bd-4641-91b7-986bf45b23ab tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:52.716729 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-965750d8-18bd-4641-91b7-986bf45b23ab tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:52.725669 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-965750d8-18bd-4641-91b7-986bf45b23ab tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:52.726222 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-965750d8-18bd-4641-91b7-986bf45b23ab tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:52.727800 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-965750d8-18bd-4641-91b7-986bf45b23ab tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:52.728304 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-965750d8-18bd-4641-91b7-986bf45b23ab tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:52.972936 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-965750d8-18bd-4641-91b7-986bf45b23ab tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:52.989462 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-965750d8-18bd-4641-91b7-986bf45b23ab tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.278090 Dec 16 14:44:52.990154 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 374/727] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:52 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:53.518403 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1188538387", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-900255515", "security_groups": [{"name": "tempest-secgroup-smoke-980036391"}], "networks": [{"uuid": "96d497b5-c921-4430-a698-604964f9d557"}], "block_device_mapping_v2": [{"uuid": "66ffbb3b-472e-47de-97cb-cabee226cb2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:53.726648 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.network.neutron [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] validate_networks() for [('96d497b5-c921-4430-a698-604964f9d557', None, None, None)] {{(pid=101914) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:44:54.458244 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Flavor limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:44:54.458987 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Image limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:44:54.459861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Flavor pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:44:54.460502 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Image pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:44:54.461264 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:44:54.475164 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:54.475498 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:54.476336 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:54.476958 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:54.497053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Getting quotas for project 46480af5f9db43618ad0897695518251. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:44:54.501787 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Getting quotas for user c00d30670c444605a25d63560d82fcbf and project 46480af5f9db43618ad0897695518251. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:44:54.616470 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Going to run 1 instances... {{(pid=101914) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:44:54.619174 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66ffbb3b-472e-47de-97cb-cabee226cb2c',volume_size=None,volume_type=None)] {{(pid=101914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:44:54.806766 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [9323c51e-02d7-40d8-bea4-25fcfeaf1c57] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:44:55.839774 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [9323c51e-02d7-40d8-bea4-25fcfeaf1c57] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 56222. Dec 16 14:44:55.854707 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bbb29945-e910-48ce-bd5c-84435dc0cce5 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.340134 Dec 16 14:44:55.856212 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 375/728] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:44:53 2021] POST /compute/v2.1/servers => generated 405 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:44:55.861135 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7ea7d3b5-3a28-4cf2-bb9c-91fc0c403ee5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:55.861761 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7ea7d3b5-3a28-4cf2-bb9c-91fc0c403ee5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:55.880839 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7ea7d3b5-3a28-4cf2-bb9c-91fc0c403ee5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:55.881295 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7ea7d3b5-3a28-4cf2-bb9c-91fc0c403ee5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:55.882076 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7ea7d3b5-3a28-4cf2-bb9c-91fc0c403ee5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:55.882505 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7ea7d3b5-3a28-4cf2-bb9c-91fc0c403ee5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:56.128670 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7ea7d3b5-3a28-4cf2-bb9c-91fc0c403ee5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:56.140662 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7ea7d3b5-3a28-4cf2-bb9c-91fc0c403ee5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.283354 Dec 16 14:44:56.141672 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 376/729] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:55 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:56.149486 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-611a2eeb-7167-45cf-b1d0-2cbacf0946e1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:56.150642 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-611a2eeb-7167-45cf-b1d0-2cbacf0946e1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:56.258549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-611a2eeb-7167-45cf-b1d0-2cbacf0946e1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:56.267606 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-611a2eeb-7167-45cf-b1d0-2cbacf0946e1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1088 microversion: 2.1 time: 0.124320 Dec 16 14:44:56.268263 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 377/730] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:56 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1088 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:57.162224 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ad77a7b3-05c9-4fce-8fd1-a9b2ba62a371 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:57.162224 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ad77a7b3-05c9-4fce-8fd1-a9b2ba62a371 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:57.169988 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ad77a7b3-05c9-4fce-8fd1-a9b2ba62a371 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:57.170433 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ad77a7b3-05c9-4fce-8fd1-a9b2ba62a371 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:57.171217 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ad77a7b3-05c9-4fce-8fd1-a9b2ba62a371 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:57.171652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ad77a7b3-05c9-4fce-8fd1-a9b2ba62a371 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:57.486813 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d25b85b7-2771-41df-9d60-8113cf0df084 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 200 len: 38397 microversion: 2.20 time: 11.344030 Dec 16 14:44:57.492686 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 354/731] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:44:46 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 38397 bytes in 11346 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:44:57.493323 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c694870c-4fbb-4ab5-b409-f93070f35251 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:57.494263 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c694870c-4fbb-4ab5-b409-f93070f35251 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:57.515342 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c694870c-4fbb-4ab5-b409-f93070f35251 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:57.515949 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c694870c-4fbb-4ab5-b409-f93070f35251 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:57.516901 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c694870c-4fbb-4ab5-b409-f93070f35251 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:57.517580 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c694870c-4fbb-4ab5-b409-f93070f35251 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:57.567996 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ad77a7b3-05c9-4fce-8fd1-a9b2ba62a371 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:57.577973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ad77a7b3-05c9-4fce-8fd1-a9b2ba62a371 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.423416 Dec 16 14:44:57.578828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 378/732] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:57 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:44:57.583911 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8fe927c6-ad6b-4cc1-9a1a-54fe47967770 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:57.584628 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8fe927c6-ad6b-4cc1-9a1a-54fe47967770 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:57.593533 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8fe927c6-ad6b-4cc1-9a1a-54fe47967770 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:57.594249 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8fe927c6-ad6b-4cc1-9a1a-54fe47967770 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:57.595221 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8fe927c6-ad6b-4cc1-9a1a-54fe47967770 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:57.595813 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8fe927c6-ad6b-4cc1-9a1a-54fe47967770 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:57.663848 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8fe927c6-ad6b-4cc1-9a1a-54fe47967770 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/ips" status: 200 len: 152 microversion: 2.20 time: 0.083595 Dec 16 14:44:57.664490 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 379/733] 10.222.0.64 () {60 vars in 1288 bytes} [Thu Dec 16 14:44:57 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/ips => generated 152 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:44:57.679316 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c694870c-4fbb-4ab5-b409-f93070f35251 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:57.689446 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c694870c-4fbb-4ab5-b409-f93070f35251 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1138 microversion: 2.1 time: 0.199432 Dec 16 14:44:57.690750 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 355/734] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:57 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1138 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:58.595880 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5c54a144-7fb7-4103-9d8a-bdef9f1d1a10 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:58.597055 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5c54a144-7fb7-4103-9d8a-bdef9f1d1a10 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:58.617369 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c54a144-7fb7-4103-9d8a-bdef9f1d1a10 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:58.618160 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c54a144-7fb7-4103-9d8a-bdef9f1d1a10 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:58.619252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c54a144-7fb7-4103-9d8a-bdef9f1d1a10 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:58.619892 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5c54a144-7fb7-4103-9d8a-bdef9f1d1a10 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:58.907487 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-7a8da96c-10dd-4bee-86a3-4149ad8fb04a req-e91032ed-6e43-455f-9c7c-ef9438f25a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13", "tag": "66acd505-3947-431a-85d5-04918d500d6b"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:44:58.909030 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:44:58.909030 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:44:58.923138 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-7a8da96c-10dd-4bee-86a3-4149ad8fb04a req-e91032ed-6e43-455f-9c7c-ef9438f25a6e service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:58.923928 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-7a8da96c-10dd-4bee-86a3-4149ad8fb04a req-e91032ed-6e43-455f-9c7c-ef9438f25a6e service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:58.943388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-7a8da96c-10dd-4bee-86a3-4149ad8fb04a req-e91032ed-6e43-455f-9c7c-ef9438f25a6e service nova] Creating event network-changed:66acd505-3947-431a-85d5-04918d500d6b for instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 on hv-cinder-82189 Dec 16 14:44:58.950091 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-7a8da96c-10dd-4bee-86a3-4149ad8fb04a req-e91032ed-6e43-455f-9c7c-ef9438f25a6e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344650 Dec 16 14:44:58.951141 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 356/735] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:44:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:44:58.957538 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7e6acca4-8d67-43a1-ae41-e007bc3dca01 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:44:58.958726 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7e6acca4-8d67-43a1-ae41-e007bc3dca01 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:44:58.968356 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e6acca4-8d67-43a1-ae41-e007bc3dca01 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:58.968817 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e6acca4-8d67-43a1-ae41-e007bc3dca01 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:58.969824 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e6acca4-8d67-43a1-ae41-e007bc3dca01 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:44:58.970427 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e6acca4-8d67-43a1-ae41-e007bc3dca01 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:44:58.992979 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5c54a144-7fb7-4103-9d8a-bdef9f1d1a10 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:59.008987 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5c54a144-7fb7-4103-9d8a-bdef9f1d1a10 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.417028 Dec 16 14:44:59.014204 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 380/736] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:58 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:44:59.125389 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7e6acca4-8d67-43a1-ae41-e007bc3dca01 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:44:59.135859 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7e6acca4-8d67-43a1-ae41-e007bc3dca01 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1204 microversion: 2.1 time: 0.183105 Dec 16 14:44:59.136457 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 357/737] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:44:58 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1204 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:00.030698 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f856710d-8951-4358-b056-997b6a5d4c8d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:00.031543 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f856710d-8951-4358-b056-997b6a5d4c8d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:00.044956 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f856710d-8951-4358-b056-997b6a5d4c8d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:00.045779 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f856710d-8951-4358-b056-997b6a5d4c8d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:00.047599 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f856710d-8951-4358-b056-997b6a5d4c8d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:00.048745 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f856710d-8951-4358-b056-997b6a5d4c8d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:00.161007 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9c58c119-366a-41d8-b9c9-f17be7eb9572 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:00.165055 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9c58c119-366a-41d8-b9c9-f17be7eb9572 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:00.183498 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9c58c119-366a-41d8-b9c9-f17be7eb9572 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:00.186672 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9c58c119-366a-41d8-b9c9-f17be7eb9572 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:00.187793 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9c58c119-366a-41d8-b9c9-f17be7eb9572 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:00.188392 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9c58c119-366a-41d8-b9c9-f17be7eb9572 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:00.579228 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f856710d-8951-4358-b056-997b6a5d4c8d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:00.588025 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f856710d-8951-4358-b056-997b6a5d4c8d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.561296 Dec 16 14:45:00.598176 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 381/738] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:00 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:00.731653 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9c58c119-366a-41d8-b9c9-f17be7eb9572 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:00.742854 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9c58c119-366a-41d8-b9c9-f17be7eb9572 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1259 microversion: 2.1 time: 0.591320 Dec 16 14:45:00.743433 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 358/739] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:00 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1259 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:01.329489 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-2cc026f1-f350-40a3-b62e-112ab56fdf77 req-0d8fbf99-8d7e-498b-82a3-63058d45fec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10a0f8d-4ce2-4f76-bdee-a88622ecf459", "tag": "1332f1d9-cf0e-479c-a21e-c9c4facfafe9"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:01.331811 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:01.331811 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:45:01.343995 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-2cc026f1-f350-40a3-b62e-112ab56fdf77 req-0d8fbf99-8d7e-498b-82a3-63058d45fec0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:01.344744 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-2cc026f1-f350-40a3-b62e-112ab56fdf77 req-0d8fbf99-8d7e-498b-82a3-63058d45fec0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:01.373769 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-2cc026f1-f350-40a3-b62e-112ab56fdf77 req-0d8fbf99-8d7e-498b-82a3-63058d45fec0 service nova] Creating event network-changed:1332f1d9-cf0e-479c-a21e-c9c4facfafe9 for instance e10a0f8d-4ce2-4f76-bdee-a88622ecf459 on hv-cinder-82189 Dec 16 14:45:01.379112 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-2cc026f1-f350-40a3-b62e-112ab56fdf77 req-0d8fbf99-8d7e-498b-82a3-63058d45fec0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131225 Dec 16 14:45:01.379860 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 382/740] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:01.605507 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c4477b2d-e993-48f4-abb1-e0f1a3495534 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:01.606110 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c4477b2d-e993-48f4-abb1-e0f1a3495534 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:01.614240 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c4477b2d-e993-48f4-abb1-e0f1a3495534 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:01.614688 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c4477b2d-e993-48f4-abb1-e0f1a3495534 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:01.615495 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c4477b2d-e993-48f4-abb1-e0f1a3495534 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:01.615924 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c4477b2d-e993-48f4-abb1-e0f1a3495534 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:01.761969 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bc9da73b-2a9a-42d7-979e-87ce5414abe2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:01.762819 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bc9da73b-2a9a-42d7-979e-87ce5414abe2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:01.772059 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc9da73b-2a9a-42d7-979e-87ce5414abe2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:01.772749 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc9da73b-2a9a-42d7-979e-87ce5414abe2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:01.776893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc9da73b-2a9a-42d7-979e-87ce5414abe2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:01.778294 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bc9da73b-2a9a-42d7-979e-87ce5414abe2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:02.002706 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c4477b2d-e993-48f4-abb1-e0f1a3495534 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:02.014000 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c4477b2d-e993-48f4-abb1-e0f1a3495534 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.412338 Dec 16 14:45:02.024472 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 359/741] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:01 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:02.208585 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bc9da73b-2a9a-42d7-979e-87ce5414abe2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:02.217977 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bc9da73b-2a9a-42d7-979e-87ce5414abe2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1259 microversion: 2.1 time: 0.460312 Dec 16 14:45:02.218840 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 383/742] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:01 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1259 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:03.031959 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ab270302-777f-471c-9281-b64ea7e5bc7d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:03.032842 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ab270302-777f-471c-9281-b64ea7e5bc7d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:03.041084 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ab270302-777f-471c-9281-b64ea7e5bc7d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:03.041530 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ab270302-777f-471c-9281-b64ea7e5bc7d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:03.042311 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ab270302-777f-471c-9281-b64ea7e5bc7d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:03.042738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ab270302-777f-471c-9281-b64ea7e5bc7d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:03.235511 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-96bd39e8-69eb-4df5-8302-1ade870cc1ce tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:03.236110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-96bd39e8-69eb-4df5-8302-1ade870cc1ce tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:03.246051 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-96bd39e8-69eb-4df5-8302-1ade870cc1ce tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:03.246499 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-96bd39e8-69eb-4df5-8302-1ade870cc1ce tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:03.247285 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-96bd39e8-69eb-4df5-8302-1ade870cc1ce tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:03.247710 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-96bd39e8-69eb-4df5-8302-1ade870cc1ce tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:03.266446 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ab270302-777f-471c-9281-b64ea7e5bc7d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:03.279927 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ab270302-777f-471c-9281-b64ea7e5bc7d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.251675 Dec 16 14:45:03.280886 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 360/743] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:03 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:03.453061 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-96bd39e8-69eb-4df5-8302-1ade870cc1ce tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:03.462756 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-96bd39e8-69eb-4df5-8302-1ade870cc1ce tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1259 microversion: 2.1 time: 0.230887 Dec 16 14:45:03.463304 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 384/744] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:03 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:04.029670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-c4ea81c4-714f-4c6f-8f81-f373ace68efa req-04eb00b4-41fd-4402-a3f1-a0e32f3ca5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13", "name": "network-vif-plugged", "status": "completed", "tag": "66acd505-3947-431a-85d5-04918d500d6b"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:04.031540 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:04.031540 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:45:04.040889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-c4ea81c4-714f-4c6f-8f81-f373ace68efa req-04eb00b4-41fd-4402-a3f1-a0e32f3ca5c9 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:04.041612 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-c4ea81c4-714f-4c6f-8f81-f373ace68efa req-04eb00b4-41fd-4402-a3f1-a0e32f3ca5c9 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:04.060511 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-c4ea81c4-714f-4c6f-8f81-f373ace68efa req-04eb00b4-41fd-4402-a3f1-a0e32f3ca5c9 service nova] Creating event network-vif-plugged:66acd505-3947-431a-85d5-04918d500d6b for instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 on hv-cinder-82189 Dec 16 14:45:04.065965 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-c4ea81c4-714f-4c6f-8f81-f373ace68efa req-04eb00b4-41fd-4402-a3f1-a0e32f3ca5c9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104380 Dec 16 14:45:04.066218 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 361/745] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:04.298242 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-aa623856-8561-4377-97d9-9c0d8ded55e0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:04.298829 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-aa623856-8561-4377-97d9-9c0d8ded55e0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:04.306898 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aa623856-8561-4377-97d9-9c0d8ded55e0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:04.307350 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aa623856-8561-4377-97d9-9c0d8ded55e0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:04.308139 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aa623856-8561-4377-97d9-9c0d8ded55e0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:04.308571 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aa623856-8561-4377-97d9-9c0d8ded55e0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:04.480591 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-eb17bb59-d221-4ec0-b9bb-5e64b931d687 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:04.481489 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-eb17bb59-d221-4ec0-b9bb-5e64b931d687 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:04.497944 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb17bb59-d221-4ec0-b9bb-5e64b931d687 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:04.498388 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb17bb59-d221-4ec0-b9bb-5e64b931d687 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:04.499190 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb17bb59-d221-4ec0-b9bb-5e64b931d687 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:04.499612 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb17bb59-d221-4ec0-b9bb-5e64b931d687 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:04.687711 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-aa623856-8561-4377-97d9-9c0d8ded55e0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:04.700576 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-aa623856-8561-4377-97d9-9c0d8ded55e0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.405867 Dec 16 14:45:04.713075 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 385/746] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:04 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:04.764274 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-eb17bb59-d221-4ec0-b9bb-5e64b931d687 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:04.773149 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-eb17bb59-d221-4ec0-b9bb-5e64b931d687 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1259 microversion: 2.1 time: 0.297223 Dec 16 14:45:04.774512 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 362/747] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:04 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1259 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:05.728997 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c7d60995-92ff-4a77-881f-d91070327271 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:05.729713 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c7d60995-92ff-4a77-881f-d91070327271 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:05.738045 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c7d60995-92ff-4a77-881f-d91070327271 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:05.738484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c7d60995-92ff-4a77-881f-d91070327271 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:05.739489 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c7d60995-92ff-4a77-881f-d91070327271 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:05.739898 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c7d60995-92ff-4a77-881f-d91070327271 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:05.797100 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-df60a9ac-14f3-46e2-a763-cc4a269cb761 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:05.799447 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-df60a9ac-14f3-46e2-a763-cc4a269cb761 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:05.823208 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-df60a9ac-14f3-46e2-a763-cc4a269cb761 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:05.823754 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-df60a9ac-14f3-46e2-a763-cc4a269cb761 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:05.824674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-df60a9ac-14f3-46e2-a763-cc4a269cb761 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:05.825215 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-df60a9ac-14f3-46e2-a763-cc4a269cb761 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:06.088064 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c7d60995-92ff-4a77-881f-d91070327271 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:06.097287 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c7d60995-92ff-4a77-881f-d91070327271 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1358 microversion: 2.1 time: 0.372615 Dec 16 14:45:06.098197 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 386/748] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:05 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1358 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:06.147191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-df60a9ac-14f3-46e2-a763-cc4a269cb761 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:06.156340 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-df60a9ac-14f3-46e2-a763-cc4a269cb761 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1259 microversion: 2.1 time: 0.368415 Dec 16 14:45:06.156954 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 363/749] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:05 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1259 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:07.115022 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-77fe64c4-08c0-478c-a65f-849d2059df99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:07.115708 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-77fe64c4-08c0-478c-a65f-849d2059df99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:07.124251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-77fe64c4-08c0-478c-a65f-849d2059df99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.124813 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-77fe64c4-08c0-478c-a65f-849d2059df99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.125831 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-77fe64c4-08c0-478c-a65f-849d2059df99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.126344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-77fe64c4-08c0-478c-a65f-849d2059df99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.173838 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-917d1964-2c07-4d0b-9e42-6ba22b831032 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:07.174494 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-917d1964-2c07-4d0b-9e42-6ba22b831032 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:07.182705 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-917d1964-2c07-4d0b-9e42-6ba22b831032 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.183178 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-917d1964-2c07-4d0b-9e42-6ba22b831032 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.183948 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-917d1964-2c07-4d0b-9e42-6ba22b831032 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.184370 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-917d1964-2c07-4d0b-9e42-6ba22b831032 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.448257 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-77fe64c4-08c0-478c-a65f-849d2059df99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:07.455529 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-917d1964-2c07-4d0b-9e42-6ba22b831032 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:07.457727 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-77fe64c4-08c0-478c-a65f-849d2059df99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1547 microversion: 2.1 time: 0.346781 Dec 16 14:45:07.458310 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 387/750] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:07 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1547 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:07.464729 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-917d1964-2c07-4d0b-9e42-6ba22b831032 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1259 microversion: 2.1 time: 0.294563 Dec 16 14:45:07.465343 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 364/751] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:07 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1259 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:45:07.474274 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-54bd024f-0a1b-4822-ba39-24b65a4dee3b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:07.474878 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-54bd024f-0a1b-4822-ba39-24b65a4dee3b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:07.483418 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-54bd024f-0a1b-4822-ba39-24b65a4dee3b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.483857 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-54bd024f-0a1b-4822-ba39-24b65a4dee3b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.484637 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-54bd024f-0a1b-4822-ba39-24b65a4dee3b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.485155 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-54bd024f-0a1b-4822-ba39-24b65a4dee3b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.690105 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-54bd024f-0a1b-4822-ba39-24b65a4dee3b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:07.699357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-54bd024f-0a1b-4822-ba39-24b65a4dee3b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1547 microversion: 2.1 time: 0.228678 Dec 16 14:45:07.699944 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 388/752] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:07 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1547 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:07.715868 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6add0d87-89dc-48f5-89de-9ccb3947ea79 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:07.719348 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:07.719348 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:45:07.720432 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6add0d87-89dc-48f5-89de-9ccb3947ea79 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:07.721225 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6add0d87-89dc-48f5-89de-9ccb3947ea79 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Searching by: {'deleted': False, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87'} {{(pid=101915) get_all /opt/stack/nova/nova/compute/api.py:2855}} Dec 16 14:45:07.727225 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6add0d87-89dc-48f5-89de-9ccb3947ea79 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.727667 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6add0d87-89dc-48f5-89de-9ccb3947ea79 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.728477 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6add0d87-89dc-48f5-89de-9ccb3947ea79 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.728962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6add0d87-89dc-48f5-89de-9ccb3947ea79 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.827819 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.multi_cell_list [None req-6add0d87-89dc-48f5-89de-9ccb3947ea79 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=101915) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Dec 16 14:45:07.922772 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6add0d87-89dc-48f5-89de-9ccb3947ea79 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210596 Dec 16 14:45:07.923356 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 365/753] 10.222.0.64 () {58 vars in 1124 bytes} [Thu Dec 16 14:45:07 2021] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:45:07.933725 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-222564eb-101f-489e-8c3c-0c2a005cd913 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:07.934510 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-222564eb-101f-489e-8c3c-0c2a005cd913 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:07.941926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-222564eb-101f-489e-8c3c-0c2a005cd913 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.943251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-222564eb-101f-489e-8c3c-0c2a005cd913 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:07.943251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-222564eb-101f-489e-8c3c-0c2a005cd913 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:07.943528 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-222564eb-101f-489e-8c3c-0c2a005cd913 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:08.154953 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-222564eb-101f-489e-8c3c-0c2a005cd913 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:08.164184 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-222564eb-101f-489e-8c3c-0c2a005cd913 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1547 microversion: 2.1 time: 0.234320 Dec 16 14:45:08.164889 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 389/754] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:07 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1547 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:08.483436 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-47bec3e4-65c6-4528-9fd4-78fadc55c155 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:08.484034 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-47bec3e4-65c6-4528-9fd4-78fadc55c155 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:08.491930 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-47bec3e4-65c6-4528-9fd4-78fadc55c155 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:08.493047 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-47bec3e4-65c6-4528-9fd4-78fadc55c155 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:08.493852 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-47bec3e4-65c6-4528-9fd4-78fadc55c155 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:08.494292 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-47bec3e4-65c6-4528-9fd4-78fadc55c155 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:08.746002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-47bec3e4-65c6-4528-9fd4-78fadc55c155 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:08.760010 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-47bec3e4-65c6-4528-9fd4-78fadc55c155 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1259 microversion: 2.1 time: 0.280700 Dec 16 14:45:08.760609 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 366/755] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:08 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1259 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:09.777764 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a4a5e197-4e26-4ccf-af8a-77c7bedab96b tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:09.778545 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a4a5e197-4e26-4ccf-af8a-77c7bedab96b tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:09.786363 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a4a5e197-4e26-4ccf-af8a-77c7bedab96b tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:09.786814 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a4a5e197-4e26-4ccf-af8a-77c7bedab96b tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:09.790671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a4a5e197-4e26-4ccf-af8a-77c7bedab96b tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:09.790671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a4a5e197-4e26-4ccf-af8a-77c7bedab96b tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:10.096546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a4a5e197-4e26-4ccf-af8a-77c7bedab96b tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:10.110223 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a4a5e197-4e26-4ccf-af8a-77c7bedab96b tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1259 microversion: 2.1 time: 0.336696 Dec 16 14:45:10.110930 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 390/756] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:09 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1259 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:10.223962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b92de896-76fa-4277-9f61-432331e0c7fd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1d9aada-5fe8-4d4d-abfd-d903ba5c9262"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:10.225058 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b92de896-76fa-4277-9f61-432331e0c7fd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:10.232858 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b92de896-76fa-4277-9f61-432331e0c7fd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:10.233394 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b92de896-76fa-4277-9f61-432331e0c7fd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:10.234215 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b92de896-76fa-4277-9f61-432331e0c7fd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:10.234649 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b92de896-76fa-4277-9f61-432331e0c7fd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:10.627515 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b92de896-76fa-4277-9f61-432331e0c7fd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "POST /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407073 Dec 16 14:45:10.628040 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 367/757] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:45:10 2021] POST /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:11.127819 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1dd2044e-2045-4a40-aa2b-bbba91e77795 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:11.128423 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1dd2044e-2045-4a40-aa2b-bbba91e77795 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:11.136490 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1dd2044e-2045-4a40-aa2b-bbba91e77795 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:11.137015 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1dd2044e-2045-4a40-aa2b-bbba91e77795 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:11.137880 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1dd2044e-2045-4a40-aa2b-bbba91e77795 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:11.138393 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1dd2044e-2045-4a40-aa2b-bbba91e77795 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:11.451607 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1dd2044e-2045-4a40-aa2b-bbba91e77795 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:11.462985 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1dd2044e-2045-4a40-aa2b-bbba91e77795 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1259 microversion: 2.1 time: 0.338406 Dec 16 14:45:11.463937 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 391/758] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:11 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:12.037332 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-24f02f24-b1b7-4ea2-91bc-7c9fc942dbbf req-50bf8b5d-a762-452d-a7a9-7b2873922a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10a0f8d-4ce2-4f76-bdee-a88622ecf459", "name": "network-vif-plugged", "status": "completed", "tag": "1332f1d9-cf0e-479c-a21e-c9c4facfafe9"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:12.039643 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:12.039643 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:45:12.050050 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-24f02f24-b1b7-4ea2-91bc-7c9fc942dbbf req-50bf8b5d-a762-452d-a7a9-7b2873922a44 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:12.050844 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-24f02f24-b1b7-4ea2-91bc-7c9fc942dbbf req-50bf8b5d-a762-452d-a7a9-7b2873922a44 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:12.068149 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-24f02f24-b1b7-4ea2-91bc-7c9fc942dbbf req-50bf8b5d-a762-452d-a7a9-7b2873922a44 service nova] Creating event network-vif-plugged:1332f1d9-cf0e-479c-a21e-c9c4facfafe9 for instance e10a0f8d-4ce2-4f76-bdee-a88622ecf459 on hv-cinder-82189 Dec 16 14:45:12.073704 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-24f02f24-b1b7-4ea2-91bc-7c9fc942dbbf req-50bf8b5d-a762-452d-a7a9-7b2873922a44 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041792 Dec 16 14:45:12.074446 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 368/759] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:45:12.481912 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ae786ba3-3c9f-4ce1-84e6-10d3db74eb81 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:12.482681 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ae786ba3-3c9f-4ce1-84e6-10d3db74eb81 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:12.490461 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ae786ba3-3c9f-4ce1-84e6-10d3db74eb81 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:12.490910 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ae786ba3-3c9f-4ce1-84e6-10d3db74eb81 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:12.491719 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ae786ba3-3c9f-4ce1-84e6-10d3db74eb81 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:12.492145 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ae786ba3-3c9f-4ce1-84e6-10d3db74eb81 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:12.695549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ae786ba3-3c9f-4ce1-84e6-10d3db74eb81 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:12.703989 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ae786ba3-3c9f-4ce1-84e6-10d3db74eb81 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1259 microversion: 2.1 time: 0.226868 Dec 16 14:45:12.704564 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 392/760] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:12 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:13.725416 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0905c53a-6a38-46da-b4c8-515a6887c780 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:13.726663 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0905c53a-6a38-46da-b4c8-515a6887c780 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:13.735200 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0905c53a-6a38-46da-b4c8-515a6887c780 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:13.735669 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0905c53a-6a38-46da-b4c8-515a6887c780 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:13.736429 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0905c53a-6a38-46da-b4c8-515a6887c780 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:13.736899 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0905c53a-6a38-46da-b4c8-515a6887c780 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:13.979903 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-0905c53a-6a38-46da-b4c8-515a6887c780 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:13.989575 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0905c53a-6a38-46da-b4c8-515a6887c780 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1443 microversion: 2.1 time: 0.271865 Dec 16 14:45:13.990244 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 369/761] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:13 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1443 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:14.021601 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a27f1ce3-56b1-4165-88eb-a850e66f5d22 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:14.023471 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a27f1ce3-56b1-4165-88eb-a850e66f5d22 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:14.048425 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a27f1ce3-56b1-4165-88eb-a850e66f5d22 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:14.049394 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a27f1ce3-56b1-4165-88eb-a850e66f5d22 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:14.050593 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a27f1ce3-56b1-4165-88eb-a850e66f5d22 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:14.051364 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a27f1ce3-56b1-4165-88eb-a850e66f5d22 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:14.271165 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a27f1ce3-56b1-4165-88eb-a850e66f5d22 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:14.280475 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a27f1ce3-56b1-4165-88eb-a850e66f5d22 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1443 microversion: 2.1 time: 0.266073 Dec 16 14:45:14.281067 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 393/762] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:14 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1443 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:15.565235 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3ece49ff-581c-4cdd-bb2b-aaa4e50691f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:15.565738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3ece49ff-581c-4cdd-bb2b-aaa4e50691f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:15.573767 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ece49ff-581c-4cdd-bb2b-aaa4e50691f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:15.574216 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ece49ff-581c-4cdd-bb2b-aaa4e50691f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:15.574979 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ece49ff-581c-4cdd-bb2b-aaa4e50691f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:15.575406 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ece49ff-581c-4cdd-bb2b-aaa4e50691f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:15.632449 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-3ece49ff-581c-4cdd-bb2b-aaa4e50691f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lazy-loading 'flavor' on Instance uuid aa5526fc-135b-4e73-882b-e446f2905447 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:45:15.990059 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3ece49ff-581c-4cdd-bb2b-aaa4e50691f6 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 202 len: 0 microversion: 2.20 time: 0.428420 Dec 16 14:45:15.991545 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 370/763] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:45:15 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:45:16.003387 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d5a010a1-42e4-47ae-a94b-bd0bd644029f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:16.004563 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d5a010a1-42e4-47ae-a94b-bd0bd644029f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:16.014765 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d5a010a1-42e4-47ae-a94b-bd0bd644029f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:16.016094 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d5a010a1-42e4-47ae-a94b-bd0bd644029f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:16.017217 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d5a010a1-42e4-47ae-a94b-bd0bd644029f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:16.017653 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d5a010a1-42e4-47ae-a94b-bd0bd644029f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:16.598973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d5a010a1-42e4-47ae-a94b-bd0bd644029f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:16.611790 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d5a010a1-42e4-47ae-a94b-bd0bd644029f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:16.613442 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d5a010a1-42e4-47ae-a94b-bd0bd644029f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:16.614649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d5a010a1-42e4-47ae-a94b-bd0bd644029f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.616840 Dec 16 14:45:16.615506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 394/764] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:15 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:17.232668 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-3575ef86-3217-4c26-b18a-64d345e27c82 req-1b9079b8-eb50-4ce8-89e0-ba9499733e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10a0f8d-4ce2-4f76-bdee-a88622ecf459", "tag": "1332f1d9-cf0e-479c-a21e-c9c4facfafe9"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:17.234461 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:17.234461 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:45:17.243246 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-3575ef86-3217-4c26-b18a-64d345e27c82 req-1b9079b8-eb50-4ce8-89e0-ba9499733e4d service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:17.243980 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-3575ef86-3217-4c26-b18a-64d345e27c82 req-1b9079b8-eb50-4ce8-89e0-ba9499733e4d service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:17.262155 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-3575ef86-3217-4c26-b18a-64d345e27c82 req-1b9079b8-eb50-4ce8-89e0-ba9499733e4d service nova] Creating event network-changed:1332f1d9-cf0e-479c-a21e-c9c4facfafe9 for instance e10a0f8d-4ce2-4f76-bdee-a88622ecf459 on hv-cinder-82189 Dec 16 14:45:17.267570 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-3575ef86-3217-4c26-b18a-64d345e27c82 req-1b9079b8-eb50-4ce8-89e0-ba9499733e4d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039442 Dec 16 14:45:17.268317 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 371/765] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:17.634031 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bb13173a-b24e-44f6-ba6d-b3c06b02ae03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:17.635969 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bb13173a-b24e-44f6-ba6d-b3c06b02ae03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:17.645167 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bb13173a-b24e-44f6-ba6d-b3c06b02ae03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:17.646052 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bb13173a-b24e-44f6-ba6d-b3c06b02ae03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:17.646997 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bb13173a-b24e-44f6-ba6d-b3c06b02ae03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:17.647419 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bb13173a-b24e-44f6-ba6d-b3c06b02ae03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:17.954975 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bb13173a-b24e-44f6-ba6d-b3c06b02ae03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:17.964462 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bb13173a-b24e-44f6-ba6d-b3c06b02ae03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:17.966296 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bb13173a-b24e-44f6-ba6d-b3c06b02ae03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:17.967584 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bb13173a-b24e-44f6-ba6d-b3c06b02ae03 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.337516 Dec 16 14:45:17.968291 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 395/766] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:17 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:18.699719 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-baf97ea7-aa37-46a5-99a8-4765410f9022 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:18.700653 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-baf97ea7-aa37-46a5-99a8-4765410f9022 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:18.709395 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-baf97ea7-aa37-46a5-99a8-4765410f9022 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:18.709737 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-baf97ea7-aa37-46a5-99a8-4765410f9022 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:18.710676 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-baf97ea7-aa37-46a5-99a8-4765410f9022 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:18.711182 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-baf97ea7-aa37-46a5-99a8-4765410f9022 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:18.989123 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2282784d-d7d3-40b8-a467-204694220436 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:18.991048 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2282784d-d7d3-40b8-a467-204694220436 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:19.017104 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2282784d-d7d3-40b8-a467-204694220436 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:19.018455 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2282784d-d7d3-40b8-a467-204694220436 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:19.019654 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2282784d-d7d3-40b8-a467-204694220436 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:19.020319 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2282784d-d7d3-40b8-a467-204694220436 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:19.063422 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-baf97ea7-aa37-46a5-99a8-4765410f9022 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:19.073362 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-baf97ea7-aa37-46a5-99a8-4765410f9022 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1593 microversion: 2.1 time: 0.378914 Dec 16 14:45:19.074099 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 372/767] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:18 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1593 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:19.406955 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2282784d-d7d3-40b8-a467-204694220436 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:19.417568 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2282784d-d7d3-40b8-a467-204694220436 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:19.419547 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2282784d-d7d3-40b8-a467-204694220436 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:19.420252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2282784d-d7d3-40b8-a467-204694220436 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.438240 Dec 16 14:45:19.427628 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 396/768] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:18 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:20.440588 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-07575cf6-cdf5-4aa7-ad79-244023290be8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:20.441310 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-07575cf6-cdf5-4aa7-ad79-244023290be8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:20.449038 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-07575cf6-cdf5-4aa7-ad79-244023290be8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:20.449567 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-07575cf6-cdf5-4aa7-ad79-244023290be8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:20.450340 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-07575cf6-cdf5-4aa7-ad79-244023290be8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:20.450773 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-07575cf6-cdf5-4aa7-ad79-244023290be8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:20.662009 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-07575cf6-cdf5-4aa7-ad79-244023290be8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:20.671886 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-07575cf6-cdf5-4aa7-ad79-244023290be8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:20.673397 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-07575cf6-cdf5-4aa7-ad79-244023290be8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:20.674533 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-07575cf6-cdf5-4aa7-ad79-244023290be8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.237846 Dec 16 14:45:20.688807 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 373/769] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:20 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:21.707207 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3b7235a3-5d51-491f-a81c-c07db1397d20 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:21.708388 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3b7235a3-5d51-491f-a81c-c07db1397d20 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:21.719796 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b7235a3-5d51-491f-a81c-c07db1397d20 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:21.720253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b7235a3-5d51-491f-a81c-c07db1397d20 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:21.721092 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b7235a3-5d51-491f-a81c-c07db1397d20 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:21.721695 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3b7235a3-5d51-491f-a81c-c07db1397d20 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:21.722744 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-527684f0-70af-4bc6-826f-deb0b0850322 req-c6e484fa-46ed-4c7a-9be4-bb9ffc200caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13", "tag": "66acd505-3947-431a-85d5-04918d500d6b"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:21.724280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:21.724280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:45:21.732500 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-527684f0-70af-4bc6-826f-deb0b0850322 req-c6e484fa-46ed-4c7a-9be4-bb9ffc200caf service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:21.733140 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-527684f0-70af-4bc6-826f-deb0b0850322 req-c6e484fa-46ed-4c7a-9be4-bb9ffc200caf service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:21.750551 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-527684f0-70af-4bc6-826f-deb0b0850322 req-c6e484fa-46ed-4c7a-9be4-bb9ffc200caf service nova] Creating event network-changed:66acd505-3947-431a-85d5-04918d500d6b for instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 on hv-cinder-82189 Dec 16 14:45:21.755967 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-527684f0-70af-4bc6-826f-deb0b0850322 req-c6e484fa-46ed-4c7a-9be4-bb9ffc200caf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036622 Dec 16 14:45:21.757139 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 374/770] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:45:22.355807 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3b7235a3-5d51-491f-a81c-c07db1397d20 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:22.373732 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3b7235a3-5d51-491f-a81c-c07db1397d20 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:22.375237 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3b7235a3-5d51-491f-a81c-c07db1397d20 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:22.376380 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3b7235a3-5d51-491f-a81c-c07db1397d20 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.678375 Dec 16 14:45:22.387157 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 397/771] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:21 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:23.401599 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e619d088-6c53-49f8-8414-38043e1233c3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:23.408217 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e619d088-6c53-49f8-8414-38043e1233c3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:23.418056 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e619d088-6c53-49f8-8414-38043e1233c3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:23.418778 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e619d088-6c53-49f8-8414-38043e1233c3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:23.419897 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e619d088-6c53-49f8-8414-38043e1233c3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:23.420517 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e619d088-6c53-49f8-8414-38043e1233c3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:23.814670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e619d088-6c53-49f8-8414-38043e1233c3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:23.826583 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e619d088-6c53-49f8-8414-38043e1233c3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:23.828659 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e619d088-6c53-49f8-8414-38043e1233c3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:23.830148 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e619d088-6c53-49f8-8414-38043e1233c3 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.439473 Dec 16 14:45:23.831399 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 375/772] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:23 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:24.172960 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8603912e-8aaa-4eac-9414-f30615452ec9 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-518630037"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:24.173694 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8603912e-8aaa-4eac-9414-f30615452ec9 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:24.182808 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8603912e-8aaa-4eac-9414-f30615452ec9 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:24.183253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8603912e-8aaa-4eac-9414-f30615452ec9 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:24.184054 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8603912e-8aaa-4eac-9414-f30615452ec9 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:24.184459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8603912e-8aaa-4eac-9414-f30615452ec9 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:24.486530 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.network.security_group_api [None req-8603912e-8aaa-4eac-9414-f30615452ec9 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Adding security group 068455a0-72ac-4e2b-886b-7f1892d1a02f to port 66acd505-3947-431a-85d5-04918d500d6b Dec 16 14:45:24.850008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-65264ea2-9765-4154-96df-7b419f9ef317 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:24.850801 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-65264ea2-9765-4154-96df-7b419f9ef317 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:24.859243 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65264ea2-9765-4154-96df-7b419f9ef317 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:24.860109 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65264ea2-9765-4154-96df-7b419f9ef317 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:24.861350 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65264ea2-9765-4154-96df-7b419f9ef317 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:24.862008 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65264ea2-9765-4154-96df-7b419f9ef317 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:25.233066 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8603912e-8aaa-4eac-9414-f30615452ec9 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "POST /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/action" status: 202 len: 0 microversion: 2.1 time: 1.059857 Dec 16 14:45:25.233066 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 398/773] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:45:24 2021] POST /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/action => generated 0 bytes in 1061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:45:25.238701 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-65264ea2-9765-4154-96df-7b419f9ef317 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:25.240315 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fdb0aa7d-0c8f-414d-be14-3abd3ee57df2 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:25.241208 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fdb0aa7d-0c8f-414d-be14-3abd3ee57df2 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:25.249831 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-65264ea2-9765-4154-96df-7b419f9ef317 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:25.251841 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-65264ea2-9765-4154-96df-7b419f9ef317 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:25.253631 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-65264ea2-9765-4154-96df-7b419f9ef317 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.408114 Dec 16 14:45:25.254961 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 376/774] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:24 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:25.257327 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fdb0aa7d-0c8f-414d-be14-3abd3ee57df2 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:25.257779 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fdb0aa7d-0c8f-414d-be14-3abd3ee57df2 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:25.258562 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fdb0aa7d-0c8f-414d-be14-3abd3ee57df2 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:25.258998 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fdb0aa7d-0c8f-414d-be14-3abd3ee57df2 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:25.261623 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-75b59841-153c-49fc-a849-883f57ed6ae4 req-3993aac4-6b31-47ab-a424-12e8705284b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13", "tag": "66acd505-3947-431a-85d5-04918d500d6b"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:25.263609 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:25.263609 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:45:25.273330 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-75b59841-153c-49fc-a849-883f57ed6ae4 req-3993aac4-6b31-47ab-a424-12e8705284b0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:25.274157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-75b59841-153c-49fc-a849-883f57ed6ae4 req-3993aac4-6b31-47ab-a424-12e8705284b0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:25.298217 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-75b59841-153c-49fc-a849-883f57ed6ae4 req-3993aac4-6b31-47ab-a424-12e8705284b0 service nova] Creating event network-changed:66acd505-3947-431a-85d5-04918d500d6b for instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 on hv-cinder-82189 Dec 16 14:45:25.305743 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-75b59841-153c-49fc-a849-883f57ed6ae4 req-3993aac4-6b31-47ab-a424-12e8705284b0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049300 Dec 16 14:45:25.306767 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 377/775] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:45:25.775106 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fdb0aa7d-0c8f-414d-be14-3abd3ee57df2 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:25.786231 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fdb0aa7d-0c8f-414d-be14-3abd3ee57df2 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1758 microversion: 2.1 time: 0.551103 Dec 16 14:45:25.787527 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 399/776] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:25 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1758 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:26.276700 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0f10657d-d45f-46ea-9f13-65a4be844400 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:26.278932 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0f10657d-d45f-46ea-9f13-65a4be844400 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:26.294837 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f10657d-d45f-46ea-9f13-65a4be844400 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:26.296031 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f10657d-d45f-46ea-9f13-65a4be844400 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:26.298383 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f10657d-d45f-46ea-9f13-65a4be844400 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:26.300142 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f10657d-d45f-46ea-9f13-65a4be844400 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:26.641484 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-0f10657d-d45f-46ea-9f13-65a4be844400 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:26.650692 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-0f10657d-d45f-46ea-9f13-65a4be844400 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:26.652186 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-0f10657d-d45f-46ea-9f13-65a4be844400 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:26.653921 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0f10657d-d45f-46ea-9f13-65a4be844400 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.385470 Dec 16 14:45:26.654482 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 378/777] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:26 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:27.671293 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-28a46cdc-cbf0-49af-96fc-5ce3600291cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:27.671894 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-28a46cdc-cbf0-49af-96fc-5ce3600291cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:27.681062 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-28a46cdc-cbf0-49af-96fc-5ce3600291cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:27.681062 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-28a46cdc-cbf0-49af-96fc-5ce3600291cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:27.681062 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-28a46cdc-cbf0-49af-96fc-5ce3600291cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:27.681062 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-28a46cdc-cbf0-49af-96fc-5ce3600291cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:27.890546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-28a46cdc-cbf0-49af-96fc-5ce3600291cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:27.899699 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-28a46cdc-cbf0-49af-96fc-5ce3600291cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:27.901354 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-28a46cdc-cbf0-49af-96fc-5ce3600291cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:27.903777 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-28a46cdc-cbf0-49af-96fc-5ce3600291cc tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.236146 Dec 16 14:45:27.904334 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 400/778] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:27 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:28.922227 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b5d4f1ed-9753-46dd-a196-1590a5496c08 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:28.922834 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b5d4f1ed-9753-46dd-a196-1590a5496c08 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:28.930486 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5d4f1ed-9753-46dd-a196-1590a5496c08 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:28.930931 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5d4f1ed-9753-46dd-a196-1590a5496c08 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:28.931728 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5d4f1ed-9753-46dd-a196-1590a5496c08 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:28.932132 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b5d4f1ed-9753-46dd-a196-1590a5496c08 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:29.123517 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b5d4f1ed-9753-46dd-a196-1590a5496c08 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:29.132220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b5d4f1ed-9753-46dd-a196-1590a5496c08 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:29.133753 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b5d4f1ed-9753-46dd-a196-1590a5496c08 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:29.134919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b5d4f1ed-9753-46dd-a196-1590a5496c08 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.216840 Dec 16 14:45:29.135419 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 379/779] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:28 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:30.152732 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3fa64e41-b916-4fd3-a400-210b468d40b0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:30.153848 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3fa64e41-b916-4fd3-a400-210b468d40b0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:30.161315 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3fa64e41-b916-4fd3-a400-210b468d40b0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:30.161769 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3fa64e41-b916-4fd3-a400-210b468d40b0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:30.162529 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3fa64e41-b916-4fd3-a400-210b468d40b0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:30.162959 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3fa64e41-b916-4fd3-a400-210b468d40b0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:30.356869 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3fa64e41-b916-4fd3-a400-210b468d40b0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:30.365958 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3fa64e41-b916-4fd3-a400-210b468d40b0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:30.367459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3fa64e41-b916-4fd3-a400-210b468d40b0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:30.368613 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3fa64e41-b916-4fd3-a400-210b468d40b0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.219662 Dec 16 14:45:30.369182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 401/780] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:30 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:31.386416 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e89d4567-85fe-4664-929f-97e77235fb9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:31.387001 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e89d4567-85fe-4664-929f-97e77235fb9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:31.394580 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e89d4567-85fe-4664-929f-97e77235fb9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:31.395021 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e89d4567-85fe-4664-929f-97e77235fb9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:31.395779 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e89d4567-85fe-4664-929f-97e77235fb9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:31.396206 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e89d4567-85fe-4664-929f-97e77235fb9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:31.585507 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e89d4567-85fe-4664-929f-97e77235fb9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:31.594497 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e89d4567-85fe-4664-929f-97e77235fb9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:31.596002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e89d4567-85fe-4664-929f-97e77235fb9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:31.597138 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e89d4567-85fe-4664-929f-97e77235fb9f tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.214378 Dec 16 14:45:31.597691 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 380/781] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:31 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:32.615631 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2ed3e50a-b06a-4a20-b58a-d4c2a3410767 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:32.616181 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2ed3e50a-b06a-4a20-b58a-d4c2a3410767 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:32.624021 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2ed3e50a-b06a-4a20-b58a-d4c2a3410767 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:32.624468 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2ed3e50a-b06a-4a20-b58a-d4c2a3410767 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:32.625249 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2ed3e50a-b06a-4a20-b58a-d4c2a3410767 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:32.625683 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2ed3e50a-b06a-4a20-b58a-d4c2a3410767 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:32.821179 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2ed3e50a-b06a-4a20-b58a-d4c2a3410767 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:32.829692 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2ed3e50a-b06a-4a20-b58a-d4c2a3410767 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:32.831252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2ed3e50a-b06a-4a20-b58a-d4c2a3410767 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:32.832397 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2ed3e50a-b06a-4a20-b58a-d4c2a3410767 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.220583 Dec 16 14:45:32.832978 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 402/782] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:32 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:33.851866 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-344bce57-719e-4537-9280-7a41b2a3c65d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:33.852482 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-344bce57-719e-4537-9280-7a41b2a3c65d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:33.859919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-344bce57-719e-4537-9280-7a41b2a3c65d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:33.860370 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-344bce57-719e-4537-9280-7a41b2a3c65d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:33.861164 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-344bce57-719e-4537-9280-7a41b2a3c65d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:33.861602 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-344bce57-719e-4537-9280-7a41b2a3c65d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:34.057071 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-344bce57-719e-4537-9280-7a41b2a3c65d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:34.066725 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-344bce57-719e-4537-9280-7a41b2a3c65d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:34.068226 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-344bce57-719e-4537-9280-7a41b2a3c65d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:34.069383 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-344bce57-719e-4537-9280-7a41b2a3c65d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.221799 Dec 16 14:45:34.069943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 381/783] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:33 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:35.087318 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fe22f132-ab30-48b1-a095-ffbf96e2507d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:35.087957 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fe22f132-ab30-48b1-a095-ffbf96e2507d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:35.095257 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe22f132-ab30-48b1-a095-ffbf96e2507d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:35.095702 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe22f132-ab30-48b1-a095-ffbf96e2507d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:35.096465 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe22f132-ab30-48b1-a095-ffbf96e2507d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:35.096927 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe22f132-ab30-48b1-a095-ffbf96e2507d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:35.290531 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fe22f132-ab30-48b1-a095-ffbf96e2507d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:35.300576 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fe22f132-ab30-48b1-a095-ffbf96e2507d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:35.302131 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fe22f132-ab30-48b1-a095-ffbf96e2507d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:35.303251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fe22f132-ab30-48b1-a095-ffbf96e2507d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.219684 Dec 16 14:45:35.303809 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 403/784] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:35 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:36.321838 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9b3334c1-c878-4c74-b709-831b5c19ba9c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:36.322499 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9b3334c1-c878-4c74-b709-831b5c19ba9c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:36.330452 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9b3334c1-c878-4c74-b709-831b5c19ba9c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:36.330904 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9b3334c1-c878-4c74-b709-831b5c19ba9c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:36.331688 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9b3334c1-c878-4c74-b709-831b5c19ba9c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:36.332122 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9b3334c1-c878-4c74-b709-831b5c19ba9c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:36.612682 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9b3334c1-c878-4c74-b709-831b5c19ba9c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:36.624293 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9b3334c1-c878-4c74-b709-831b5c19ba9c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:36.625568 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9b3334c1-c878-4c74-b709-831b5c19ba9c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:36.626744 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9b3334c1-c878-4c74-b709-831b5c19ba9c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.308744 Dec 16 14:45:36.627290 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 382/785] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:36 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:37.645722 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-555fbc82-9272-465b-b4d7-a63783fae0d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:37.646345 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-555fbc82-9272-465b-b4d7-a63783fae0d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:37.653716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-555fbc82-9272-465b-b4d7-a63783fae0d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:37.654165 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-555fbc82-9272-465b-b4d7-a63783fae0d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:37.654926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-555fbc82-9272-465b-b4d7-a63783fae0d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:37.655359 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-555fbc82-9272-465b-b4d7-a63783fae0d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:37.851017 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-555fbc82-9272-465b-b4d7-a63783fae0d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:37.860107 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-555fbc82-9272-465b-b4d7-a63783fae0d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:37.861629 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-555fbc82-9272-465b-b4d7-a63783fae0d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:37.862727 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-555fbc82-9272-465b-b4d7-a63783fae0d9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.220958 Dec 16 14:45:37.863275 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 404/786] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:37 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:38.880425 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8b189024-32a3-4aef-9003-88cd8f937d94 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:38.881147 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8b189024-32a3-4aef-9003-88cd8f937d94 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:38.888653 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8b189024-32a3-4aef-9003-88cd8f937d94 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:38.889180 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8b189024-32a3-4aef-9003-88cd8f937d94 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:38.889951 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8b189024-32a3-4aef-9003-88cd8f937d94 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:38.890386 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8b189024-32a3-4aef-9003-88cd8f937d94 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:39.081921 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8b189024-32a3-4aef-9003-88cd8f937d94 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:39.090514 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8b189024-32a3-4aef-9003-88cd8f937d94 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:39.092005 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8b189024-32a3-4aef-9003-88cd8f937d94 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:39.093664 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8b189024-32a3-4aef-9003-88cd8f937d94 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.217054 Dec 16 14:45:39.094220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 383/787] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:38 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:40.112161 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-cad95185-cd59-47e0-8b10-b9e5612ee633 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:40.112728 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-cad95185-cd59-47e0-8b10-b9e5612ee633 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:40.119886 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cad95185-cd59-47e0-8b10-b9e5612ee633 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:40.120330 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cad95185-cd59-47e0-8b10-b9e5612ee633 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:40.121139 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cad95185-cd59-47e0-8b10-b9e5612ee633 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:40.121571 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cad95185-cd59-47e0-8b10-b9e5612ee633 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:40.317562 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-cad95185-cd59-47e0-8b10-b9e5612ee633 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:40.325979 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-cad95185-cd59-47e0-8b10-b9e5612ee633 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:40.327454 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-cad95185-cd59-47e0-8b10-b9e5612ee633 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:40.328556 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-cad95185-cd59-47e0-8b10-b9e5612ee633 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.220910 Dec 16 14:45:40.329125 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 405/788] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:40 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:41.346395 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c3ca1d26-e1f4-448a-bff6-ff026a69feac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:41.347535 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c3ca1d26-e1f4-448a-bff6-ff026a69feac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:41.355683 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c3ca1d26-e1f4-448a-bff6-ff026a69feac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:41.356208 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c3ca1d26-e1f4-448a-bff6-ff026a69feac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:41.357108 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c3ca1d26-e1f4-448a-bff6-ff026a69feac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:41.357602 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c3ca1d26-e1f4-448a-bff6-ff026a69feac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:41.560818 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c3ca1d26-e1f4-448a-bff6-ff026a69feac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:41.570179 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c3ca1d26-e1f4-448a-bff6-ff026a69feac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:41.571724 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c3ca1d26-e1f4-448a-bff6-ff026a69feac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:41.573001 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c3ca1d26-e1f4-448a-bff6-ff026a69feac tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.230511 Dec 16 14:45:41.573553 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 384/789] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:41 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:42.590376 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9650af5c-67d9-49b5-a286-2012c1a0ff67 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:42.590999 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9650af5c-67d9-49b5-a286-2012c1a0ff67 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:42.598740 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9650af5c-67d9-49b5-a286-2012c1a0ff67 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:42.599186 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9650af5c-67d9-49b5-a286-2012c1a0ff67 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:42.599940 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9650af5c-67d9-49b5-a286-2012c1a0ff67 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:42.600365 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9650af5c-67d9-49b5-a286-2012c1a0ff67 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:42.796740 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9650af5c-67d9-49b5-a286-2012c1a0ff67 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:42.805477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9650af5c-67d9-49b5-a286-2012c1a0ff67 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:42.807010 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9650af5c-67d9-49b5-a286-2012c1a0ff67 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:42.808125 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9650af5c-67d9-49b5-a286-2012c1a0ff67 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.221560 Dec 16 14:45:42.808671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 406/790] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:42 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:43.825632 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-98b93b88-90f4-46fc-ba9e-63350e2c04e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:43.826237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-98b93b88-90f4-46fc-ba9e-63350e2c04e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:43.834016 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-98b93b88-90f4-46fc-ba9e-63350e2c04e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:43.834460 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-98b93b88-90f4-46fc-ba9e-63350e2c04e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:43.835223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-98b93b88-90f4-46fc-ba9e-63350e2c04e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:43.835654 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-98b93b88-90f4-46fc-ba9e-63350e2c04e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:44.037807 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-98b93b88-90f4-46fc-ba9e-63350e2c04e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:44.047320 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-98b93b88-90f4-46fc-ba9e-63350e2c04e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:44.048846 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-98b93b88-90f4-46fc-ba9e-63350e2c04e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:44.049962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-98b93b88-90f4-46fc-ba9e-63350e2c04e9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.228122 Dec 16 14:45:44.050506 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 385/791] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:43 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:45.067877 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ad4ca6ea-65b8-4a75-8384-e88d1daca17c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:45.068483 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ad4ca6ea-65b8-4a75-8384-e88d1daca17c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:45.075758 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ad4ca6ea-65b8-4a75-8384-e88d1daca17c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:45.076210 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ad4ca6ea-65b8-4a75-8384-e88d1daca17c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:45.077075 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ad4ca6ea-65b8-4a75-8384-e88d1daca17c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:45.077513 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ad4ca6ea-65b8-4a75-8384-e88d1daca17c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:45.277877 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ad4ca6ea-65b8-4a75-8384-e88d1daca17c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:45.286623 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ad4ca6ea-65b8-4a75-8384-e88d1daca17c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:45.288132 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ad4ca6ea-65b8-4a75-8384-e88d1daca17c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:45.289299 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ad4ca6ea-65b8-4a75-8384-e88d1daca17c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.225336 Dec 16 14:45:45.289861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 407/792] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:45 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:46.307205 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ab3d5bfa-28ae-49ec-b246-6d0bcb589faa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:46.307819 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ab3d5bfa-28ae-49ec-b246-6d0bcb589faa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:46.315726 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ab3d5bfa-28ae-49ec-b246-6d0bcb589faa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:46.316336 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ab3d5bfa-28ae-49ec-b246-6d0bcb589faa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:46.316989 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ab3d5bfa-28ae-49ec-b246-6d0bcb589faa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:46.317420 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ab3d5bfa-28ae-49ec-b246-6d0bcb589faa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:46.515155 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ab3d5bfa-28ae-49ec-b246-6d0bcb589faa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:46.525743 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ab3d5bfa-28ae-49ec-b246-6d0bcb589faa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:46.527257 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ab3d5bfa-28ae-49ec-b246-6d0bcb589faa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:46.528367 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ab3d5bfa-28ae-49ec-b246-6d0bcb589faa tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.224874 Dec 16 14:45:46.528954 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 386/793] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:46 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:47.546814 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0d694568-cac6-48e3-b5cd-88e1afd5630e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:47.548025 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0d694568-cac6-48e3-b5cd-88e1afd5630e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:47.555269 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d694568-cac6-48e3-b5cd-88e1afd5630e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:47.555711 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d694568-cac6-48e3-b5cd-88e1afd5630e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:47.556478 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d694568-cac6-48e3-b5cd-88e1afd5630e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:47.556938 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d694568-cac6-48e3-b5cd-88e1afd5630e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:47.754459 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0d694568-cac6-48e3-b5cd-88e1afd5630e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:47.762871 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0d694568-cac6-48e3-b5cd-88e1afd5630e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:47.764362 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0d694568-cac6-48e3-b5cd-88e1afd5630e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:47.765510 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0d694568-cac6-48e3-b5cd-88e1afd5630e tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1745 microversion: 2.20 time: 0.222482 Dec 16 14:45:47.766145 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 408/794] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:47 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:48.783352 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5f8830ee-557d-488c-887d-0a92f2c8a204 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:48.783923 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5f8830ee-557d-488c-887d-0a92f2c8a204 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:48.791126 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f8830ee-557d-488c-887d-0a92f2c8a204 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:48.791569 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f8830ee-557d-488c-887d-0a92f2c8a204 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:48.792317 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f8830ee-557d-488c-887d-0a92f2c8a204 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:48.792745 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5f8830ee-557d-488c-887d-0a92f2c8a204 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:48.993299 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5f8830ee-557d-488c-887d-0a92f2c8a204 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:49.008749 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5f8830ee-557d-488c-887d-0a92f2c8a204 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:49.010295 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5f8830ee-557d-488c-887d-0a92f2c8a204 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:49.011454 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5f8830ee-557d-488c-887d-0a92f2c8a204 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1745 microversion: 2.20 time: 0.231887 Dec 16 14:45:49.012324 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 387/795] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:48 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1745 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:50.037903 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b73b21a8-8326-4030-b1b8-49fae03955bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:50.039339 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b73b21a8-8326-4030-b1b8-49fae03955bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:50.048427 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b73b21a8-8326-4030-b1b8-49fae03955bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.049198 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b73b21a8-8326-4030-b1b8-49fae03955bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.050644 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b73b21a8-8326-4030-b1b8-49fae03955bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.051260 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b73b21a8-8326-4030-b1b8-49fae03955bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.298052 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-1cdd84db-ae7f-4fa8-925c-d5ad9f9c57ea req-e1c1f62f-2415-4035-9d35-bc246587e07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5526fc-135b-4e73-882b-e446f2905447", "name": "network-vif-plugged", "status": "completed", "tag": "863ee071-cd68-4318-b951-baa44727d00f"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:50.302051 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b73b21a8-8326-4030-b1b8-49fae03955bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:50.307951 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:45:50.307951 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:45:50.320328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b73b21a8-8326-4030-b1b8-49fae03955bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:50.323789 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b73b21a8-8326-4030-b1b8-49fae03955bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:50.326360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b73b21a8-8326-4030-b1b8-49fae03955bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1740 microversion: 2.20 time: 0.299765 Dec 16 14:45:50.327572 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-1cdd84db-ae7f-4fa8-925c-d5ad9f9c57ea req-e1c1f62f-2415-4035-9d35-bc246587e07e service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:50.339749 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-1cdd84db-ae7f-4fa8-925c-d5ad9f9c57ea req-e1c1f62f-2415-4035-9d35-bc246587e07e service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:50.340449 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 409/796] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:50 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:50.369930 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-1cdd84db-ae7f-4fa8-925c-d5ad9f9c57ea req-e1c1f62f-2415-4035-9d35-bc246587e07e service nova] Creating event network-vif-plugged:863ee071-cd68-4318-b951-baa44727d00f for instance aa5526fc-135b-4e73-882b-e446f2905447 on hv-cinder-82189 Dec 16 14:45:50.375406 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-1cdd84db-ae7f-4fa8-925c-d5ad9f9c57ea req-e1c1f62f-2415-4035-9d35-bc246587e07e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081007 Dec 16 14:45:50.377200 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 388/797] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:45:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:45:51.347154 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f8b9ffbd-93ca-43c2-952b-c475b409cc42 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:51.348704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f8b9ffbd-93ca-43c2-952b-c475b409cc42 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:51.356596 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f8b9ffbd-93ca-43c2-952b-c475b409cc42 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.357495 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f8b9ffbd-93ca-43c2-952b-c475b409cc42 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.358331 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f8b9ffbd-93ca-43c2-952b-c475b409cc42 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.358831 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f8b9ffbd-93ca-43c2-952b-c475b409cc42 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.420173 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-47a487f1-3e8a-4a31-bc50-c6e5cc60ad18 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:45:51.423017 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-47a487f1-3e8a-4a31-bc50-c6e5cc60ad18 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:51.433013 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-47a487f1-3e8a-4a31-bc50-c6e5cc60ad18 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.433732 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-47a487f1-3e8a-4a31-bc50-c6e5cc60ad18 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.439793 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-47a487f1-3e8a-4a31-bc50-c6e5cc60ad18 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.441161 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-47a487f1-3e8a-4a31-bc50-c6e5cc60ad18 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.586171 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f8b9ffbd-93ca-43c2-952b-c475b409cc42 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:51.596035 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f8b9ffbd-93ca-43c2-952b-c475b409cc42 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:51.597951 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f8b9ffbd-93ca-43c2-952b-c475b409cc42 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:51.599515 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f8b9ffbd-93ca-43c2-952b-c475b409cc42 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1740 microversion: 2.20 time: 0.256778 Dec 16 14:45:51.600235 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 410/798] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:51 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:51.633005 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-47a487f1-3e8a-4a31-bc50-c6e5cc60ad18 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "POST /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/action" status: 202 len: 0 microversion: 2.1 time: 0.220825 Dec 16 14:45:51.633770 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 389/799] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:45:51 2021] POST /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:45:51.644008 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d2582945-4689-485e-9787-9bc3702613d3 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:51.644707 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d2582945-4689-485e-9787-9bc3702613d3 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:51.652958 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d2582945-4689-485e-9787-9bc3702613d3 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.653480 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d2582945-4689-485e-9787-9bc3702613d3 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:51.654447 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d2582945-4689-485e-9787-9bc3702613d3 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:51.656090 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d2582945-4689-485e-9787-9bc3702613d3 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:52.089033 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d2582945-4689-485e-9787-9bc3702613d3 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:52.103225 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d2582945-4689-485e-9787-9bc3702613d3 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1750 microversion: 2.1 time: 0.463952 Dec 16 14:45:52.104094 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 411/800] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:51 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1750 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:52.621879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-83f417d1-0f65-4f43-bc03-37d3a6ef7f71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:52.623339 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-83f417d1-0f65-4f43-bc03-37d3a6ef7f71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:52.631269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83f417d1-0f65-4f43-bc03-37d3a6ef7f71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:52.632134 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83f417d1-0f65-4f43-bc03-37d3a6ef7f71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:52.633187 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83f417d1-0f65-4f43-bc03-37d3a6ef7f71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:52.633828 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83f417d1-0f65-4f43-bc03-37d3a6ef7f71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:52.949006 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-83f417d1-0f65-4f43-bc03-37d3a6ef7f71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:52.960537 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-83f417d1-0f65-4f43-bc03-37d3a6ef7f71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:52.962055 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-83f417d1-0f65-4f43-bc03-37d3a6ef7f71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:52.963204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-83f417d1-0f65-4f43-bc03-37d3a6ef7f71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1740 microversion: 2.20 time: 0.349077 Dec 16 14:45:52.963945 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 390/801] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:52 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:53.121137 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-eb02432a-900e-4bee-9320-5759f88c721b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:53.125004 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-eb02432a-900e-4bee-9320-5759f88c721b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:53.133314 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eb02432a-900e-4bee-9320-5759f88c721b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.134114 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eb02432a-900e-4bee-9320-5759f88c721b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:53.135458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eb02432a-900e-4bee-9320-5759f88c721b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.136152 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eb02432a-900e-4bee-9320-5759f88c721b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:53.349384 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-eb02432a-900e-4bee-9320-5759f88c721b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:53.359218 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-eb02432a-900e-4bee-9320-5759f88c721b tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1755 microversion: 2.1 time: 0.241774 Dec 16 14:45:53.360117 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 412/802] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:53 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:53.981508 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6a7dae70-771c-41dd-9296-22d0ec6f9c93 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:53.986226 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6a7dae70-771c-41dd-9296-22d0ec6f9c93 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:53.994202 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6a7dae70-771c-41dd-9296-22d0ec6f9c93 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.994658 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6a7dae70-771c-41dd-9296-22d0ec6f9c93 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:53.995433 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6a7dae70-771c-41dd-9296-22d0ec6f9c93 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:53.995862 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6a7dae70-771c-41dd-9296-22d0ec6f9c93 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:54.220827 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6a7dae70-771c-41dd-9296-22d0ec6f9c93 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:54.230911 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6a7dae70-771c-41dd-9296-22d0ec6f9c93 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:54.235094 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6a7dae70-771c-41dd-9296-22d0ec6f9c93 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:54.235094 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6a7dae70-771c-41dd-9296-22d0ec6f9c93 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1740 microversion: 2.20 time: 0.256105 Dec 16 14:45:54.236154 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 391/803] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:53 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:54.379068 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fe42a975-5ea1-4586-a392-32b61973bc44 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:54.379676 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fe42a975-5ea1-4586-a392-32b61973bc44 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:54.387542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe42a975-5ea1-4586-a392-32b61973bc44 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:54.388040 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe42a975-5ea1-4586-a392-32b61973bc44 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:54.389041 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe42a975-5ea1-4586-a392-32b61973bc44 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:54.389785 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe42a975-5ea1-4586-a392-32b61973bc44 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:54.611329 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fe42a975-5ea1-4586-a392-32b61973bc44 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:54.620506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fe42a975-5ea1-4586-a392-32b61973bc44 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1755 microversion: 2.1 time: 0.245523 Dec 16 14:45:54.630353 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 413/804] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:54 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:55.254537 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f4c2837c-fd38-47d1-9f8d-2a155c43ecf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:55.255152 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f4c2837c-fd38-47d1-9f8d-2a155c43ecf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:55.268712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f4c2837c-fd38-47d1-9f8d-2a155c43ecf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:55.269460 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f4c2837c-fd38-47d1-9f8d-2a155c43ecf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:55.270234 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f4c2837c-fd38-47d1-9f8d-2a155c43ecf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:55.270665 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f4c2837c-fd38-47d1-9f8d-2a155c43ecf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:55.482485 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f4c2837c-fd38-47d1-9f8d-2a155c43ecf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:55.491593 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f4c2837c-fd38-47d1-9f8d-2a155c43ecf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:55.493104 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f4c2837c-fd38-47d1-9f8d-2a155c43ecf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:55.494215 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f4c2837c-fd38-47d1-9f8d-2a155c43ecf8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1740 microversion: 2.20 time: 0.243829 Dec 16 14:45:55.494985 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 392/805] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:55 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:55.637758 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b23e93fb-b974-48b7-a19e-f135cea5d299 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:55.638312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b23e93fb-b974-48b7-a19e-f135cea5d299 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:55.646830 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b23e93fb-b974-48b7-a19e-f135cea5d299 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:55.647591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b23e93fb-b974-48b7-a19e-f135cea5d299 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:55.648592 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b23e93fb-b974-48b7-a19e-f135cea5d299 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:55.649137 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b23e93fb-b974-48b7-a19e-f135cea5d299 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:55.858506 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b23e93fb-b974-48b7-a19e-f135cea5d299 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:55.868422 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b23e93fb-b974-48b7-a19e-f135cea5d299 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1755 microversion: 2.1 time: 0.234480 Dec 16 14:45:55.880063 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 414/806] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:55 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:56.513338 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7af67631-2fc2-45d7-8d1e-c9739c6f2009 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:56.514741 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7af67631-2fc2-45d7-8d1e-c9739c6f2009 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:56.522703 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7af67631-2fc2-45d7-8d1e-c9739c6f2009 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:56.523182 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7af67631-2fc2-45d7-8d1e-c9739c6f2009 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:56.523976 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7af67631-2fc2-45d7-8d1e-c9739c6f2009 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:56.524406 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7af67631-2fc2-45d7-8d1e-c9739c6f2009 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:56.886669 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f177f575-12eb-4d7d-997a-cac3cf2f1f99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:56.887549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f177f575-12eb-4d7d-997a-cac3cf2f1f99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:56.901363 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f177f575-12eb-4d7d-997a-cac3cf2f1f99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:56.903061 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f177f575-12eb-4d7d-997a-cac3cf2f1f99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:56.904026 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f177f575-12eb-4d7d-997a-cac3cf2f1f99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:56.907051 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f177f575-12eb-4d7d-997a-cac3cf2f1f99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:56.920647 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7af67631-2fc2-45d7-8d1e-c9739c6f2009 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:56.931882 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7af67631-2fc2-45d7-8d1e-c9739c6f2009 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:56.933964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7af67631-2fc2-45d7-8d1e-c9739c6f2009 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:56.935227 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7af67631-2fc2-45d7-8d1e-c9739c6f2009 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1740 microversion: 2.20 time: 0.426032 Dec 16 14:45:56.944881 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 393/807] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:56 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1740 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:57.115238 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f177f575-12eb-4d7d-997a-cac3cf2f1f99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:57.125057 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f177f575-12eb-4d7d-997a-cac3cf2f1f99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1755 microversion: 2.1 time: 0.241903 Dec 16 14:45:57.125814 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 415/808] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:56 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:57.952892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-dadc2888-765e-453e-93d2-ff00573b8bb4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:57.953477 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-dadc2888-765e-453e-93d2-ff00573b8bb4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:57.960927 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dadc2888-765e-453e-93d2-ff00573b8bb4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:57.961381 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dadc2888-765e-453e-93d2-ff00573b8bb4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:57.962125 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dadc2888-765e-453e-93d2-ff00573b8bb4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:57.962553 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-dadc2888-765e-453e-93d2-ff00573b8bb4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:58.141997 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d63b967e-6fc7-4c77-84a6-f6d0e0172768 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:58.142546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d63b967e-6fc7-4c77-84a6-f6d0e0172768 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:58.153015 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d63b967e-6fc7-4c77-84a6-f6d0e0172768 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:58.153663 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d63b967e-6fc7-4c77-84a6-f6d0e0172768 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:58.154474 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d63b967e-6fc7-4c77-84a6-f6d0e0172768 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:58.154922 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d63b967e-6fc7-4c77-84a6-f6d0e0172768 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:58.164231 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-dadc2888-765e-453e-93d2-ff00573b8bb4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:58.172847 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-dadc2888-765e-453e-93d2-ff00573b8bb4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:58.174350 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-dadc2888-765e-453e-93d2-ff00573b8bb4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:58.175959 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-dadc2888-765e-453e-93d2-ff00573b8bb4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1740 microversion: 2.20 time: 0.226896 Dec 16 14:45:58.176505 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 394/809] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:57 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:45:58.360114 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d63b967e-6fc7-4c77-84a6-f6d0e0172768 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:58.369669 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d63b967e-6fc7-4c77-84a6-f6d0e0172768 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1755 microversion: 2.1 time: 0.231348 Dec 16 14:45:58.370251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 416/810] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:58 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1755 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:45:59.194480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-02fe2d27-ca32-4112-a759-a24f43b877a7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:59.195145 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-02fe2d27-ca32-4112-a759-a24f43b877a7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:59.203037 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-02fe2d27-ca32-4112-a759-a24f43b877a7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:59.203486 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-02fe2d27-ca32-4112-a759-a24f43b877a7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:59.204281 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-02fe2d27-ca32-4112-a759-a24f43b877a7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:59.204718 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-02fe2d27-ca32-4112-a759-a24f43b877a7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:59.386312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0a4e5b22-1ae7-4438-b222-f6a179a0ee59 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:45:59.387020 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0a4e5b22-1ae7-4438-b222-f6a179a0ee59 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:45:59.395516 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0a4e5b22-1ae7-4438-b222-f6a179a0ee59 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:59.395968 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0a4e5b22-1ae7-4438-b222-f6a179a0ee59 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:59.396756 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0a4e5b22-1ae7-4438-b222-f6a179a0ee59 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:45:59.397213 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0a4e5b22-1ae7-4438-b222-f6a179a0ee59 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:45:59.569361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-02fe2d27-ca32-4112-a759-a24f43b877a7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:59.577978 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-02fe2d27-ca32-4112-a759-a24f43b877a7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:59.579478 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-02fe2d27-ca32-4112-a759-a24f43b877a7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:59.580602 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-02fe2d27-ca32-4112-a759-a24f43b877a7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1722 microversion: 2.20 time: 0.390493 Dec 16 14:45:59.581435 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 395/811] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:45:59 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:45:59.742548 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0a4e5b22-1ae7-4438-b222-f6a179a0ee59 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:45:59.751122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0a4e5b22-1ae7-4438-b222-f6a179a0ee59 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1755 microversion: 2.1 time: 0.368462 Dec 16 14:45:59.751693 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 417/812] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:45:59 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1755 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:00.599629 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8328fa1c-dd7f-4d3f-a536-640f68571100 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:00.600246 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8328fa1c-dd7f-4d3f-a536-640f68571100 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:00.607828 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8328fa1c-dd7f-4d3f-a536-640f68571100 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:00.608314 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8328fa1c-dd7f-4d3f-a536-640f68571100 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:00.609141 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8328fa1c-dd7f-4d3f-a536-640f68571100 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:00.609572 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8328fa1c-dd7f-4d3f-a536-640f68571100 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:00.768053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7ed3cd64-1370-4296-af70-630ac2626055 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:00.768614 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7ed3cd64-1370-4296-af70-630ac2626055 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:00.777505 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7ed3cd64-1370-4296-af70-630ac2626055 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:00.777950 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7ed3cd64-1370-4296-af70-630ac2626055 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:00.778720 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7ed3cd64-1370-4296-af70-630ac2626055 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:00.779149 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7ed3cd64-1370-4296-af70-630ac2626055 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:00.819681 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8328fa1c-dd7f-4d3f-a536-640f68571100 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:00.828727 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8328fa1c-dd7f-4d3f-a536-640f68571100 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:00.830249 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8328fa1c-dd7f-4d3f-a536-640f68571100 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:00.831409 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8328fa1c-dd7f-4d3f-a536-640f68571100 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1722 microversion: 2.20 time: 0.236092 Dec 16 14:46:00.834806 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 396/813] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:00 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:00.985090 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7ed3cd64-1370-4296-af70-630ac2626055 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:00.994178 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7ed3cd64-1370-4296-af70-630ac2626055 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1755 microversion: 2.1 time: 0.230076 Dec 16 14:46:00.994752 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 418/814] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:00 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1755 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:01.849968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f70f0f0b-b19d-46a3-b9cc-89750c43da5a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:01.850535 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f70f0f0b-b19d-46a3-b9cc-89750c43da5a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:01.857779 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f70f0f0b-b19d-46a3-b9cc-89750c43da5a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:01.858222 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f70f0f0b-b19d-46a3-b9cc-89750c43da5a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:01.858977 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f70f0f0b-b19d-46a3-b9cc-89750c43da5a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:01.859403 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f70f0f0b-b19d-46a3-b9cc-89750c43da5a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:02.010366 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fe788fa2-e85b-4f34-ac82-618f377e3e1d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:02.011009 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fe788fa2-e85b-4f34-ac82-618f377e3e1d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:02.018325 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe788fa2-e85b-4f34-ac82-618f377e3e1d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:02.018770 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe788fa2-e85b-4f34-ac82-618f377e3e1d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:02.019603 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe788fa2-e85b-4f34-ac82-618f377e3e1d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:02.020034 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fe788fa2-e85b-4f34-ac82-618f377e3e1d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:02.063522 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f70f0f0b-b19d-46a3-b9cc-89750c43da5a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:02.074473 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f70f0f0b-b19d-46a3-b9cc-89750c43da5a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:02.077420 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f70f0f0b-b19d-46a3-b9cc-89750c43da5a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:02.079209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f70f0f0b-b19d-46a3-b9cc-89750c43da5a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1725 microversion: 2.20 time: 0.233293 Dec 16 14:46:02.080279 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 397/815] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:01 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:02.099027 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6758f0b1-8c25-482f-9ab3-a545d192d608 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0393914-522d-4674-8825-337d404c8450"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:02.100570 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6758f0b1-8c25-482f-9ab3-a545d192d608 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:02.108265 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6758f0b1-8c25-482f-9ab3-a545d192d608 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:02.108890 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6758f0b1-8c25-482f-9ab3-a545d192d608 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:02.109811 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6758f0b1-8c25-482f-9ab3-a545d192d608 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:02.110347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6758f0b1-8c25-482f-9ab3-a545d192d608 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:02.236216 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fe788fa2-e85b-4f34-ac82-618f377e3e1d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:02.246844 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fe788fa2-e85b-4f34-ac82-618f377e3e1d tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1755 microversion: 2.1 time: 0.240009 Dec 16 14:46:02.253027 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 419/816] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:02 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:02.253027 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-68a90f39-a85b-4ae7-b73f-68e78b8b41fa req-0a28e348-be5b-4cc5-9bf5-abcb9b457e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5526fc-135b-4e73-882b-e446f2905447", "name": "network-vif-unplugged", "status": "completed", "tag": "863ee071-cd68-4318-b951-baa44727d00f"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:02.253704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:02.253704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:46:02.262285 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-68a90f39-a85b-4ae7-b73f-68e78b8b41fa req-0a28e348-be5b-4cc5-9bf5-abcb9b457e76 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:02.262727 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-68a90f39-a85b-4ae7-b73f-68e78b8b41fa req-0a28e348-be5b-4cc5-9bf5-abcb9b457e76 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:02.278742 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.compute.server_external_events [req-68a90f39-a85b-4ae7-b73f-68e78b8b41fa req-0a28e348-be5b-4cc5-9bf5-abcb9b457e76 service nova] Unable to find a host for instance aa5526fc-135b-4e73-882b-e446f2905447. Dropping event network-vif-unplugged {{(pid=101914) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 16 14:46:02.279606 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-68a90f39-a85b-4ae7-b73f-68e78b8b41fa req-0a28e348-be5b-4cc5-9bf5-abcb9b457e76 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031260 Dec 16 14:46:02.280353 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 420/817] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:02 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 16 14:46:02.562538 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6758f0b1-8c25-482f-9ab3-a545d192d608 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.468672 Dec 16 14:46:02.563154 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 398/818] 10.222.0.64 () {62 vars in 1363 bytes} [Thu Dec 16 14:46:02 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/os-volume_attachments => generated 188 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:46:02.759503 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0ac58ac5-9877-41e3-9200-61c1b970bf73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:02.760049 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0ac58ac5-9877-41e3-9200-61c1b970bf73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:02.767239 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0ac58ac5-9877-41e3-9200-61c1b970bf73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:02.767684 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0ac58ac5-9877-41e3-9200-61c1b970bf73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:02.768450 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0ac58ac5-9877-41e3-9200-61c1b970bf73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:02.768913 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0ac58ac5-9877-41e3-9200-61c1b970bf73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.190940 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0ac58ac5-9877-41e3-9200-61c1b970bf73 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/os-volume_attachments/c0393914-522d-4674-8825-337d404c8450" status: 202 len: 0 microversion: 2.20 time: 0.435207 Dec 16 14:46:03.192237 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 421/819] 10.222.0.64 () {60 vars in 1456 bytes} [Thu Dec 16 14:46:02 2021] DELETE /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/os-volume_attachments/c0393914-522d-4674-8825-337d404c8450 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:46:03.264460 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-61c985a2-c04f-4262-8142-be7ca5c0f454 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:03.265158 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-61c985a2-c04f-4262-8142-be7ca5c0f454 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:03.272945 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61c985a2-c04f-4262-8142-be7ca5c0f454 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:03.273397 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61c985a2-c04f-4262-8142-be7ca5c0f454 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.274165 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61c985a2-c04f-4262-8142-be7ca5c0f454 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:03.274597 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61c985a2-c04f-4262-8142-be7ca5c0f454 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.288233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e90317bb-df55-4e00-943e-83bcb2fdbf71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:03.288906 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e90317bb-df55-4e00-943e-83bcb2fdbf71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:03.296242 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e90317bb-df55-4e00-943e-83bcb2fdbf71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:03.296774 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e90317bb-df55-4e00-943e-83bcb2fdbf71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.297748 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e90317bb-df55-4e00-943e-83bcb2fdbf71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:03.298251 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e90317bb-df55-4e00-943e-83bcb2fdbf71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.444936 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e90317bb-df55-4e00-943e-83bcb2fdbf71 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action" status: 202 len: 0 microversion: 2.20 time: 0.160231 Dec 16 14:46:03.448822 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 422/820] 10.222.0.64 () {62 vars in 1318 bytes} [Thu Dec 16 14:46:03 2021] POST /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:46:03.453498 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7774f6a3-abe3-4b90-9a5f-e551d6015552 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:03.454095 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7774f6a3-abe3-4b90-9a5f-e551d6015552 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:03.462360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7774f6a3-abe3-4b90-9a5f-e551d6015552 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:03.462539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7774f6a3-abe3-4b90-9a5f-e551d6015552 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.463264 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7774f6a3-abe3-4b90-9a5f-e551d6015552 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:03.463753 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7774f6a3-abe3-4b90-9a5f-e551d6015552 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:03.478059 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-61c985a2-c04f-4262-8142-be7ca5c0f454 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:03.492637 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-61c985a2-c04f-4262-8142-be7ca5c0f454 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1755 microversion: 2.1 time: 0.231758 Dec 16 14:46:03.493485 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 399/821] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:03 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1755 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:03.666539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7774f6a3-abe3-4b90-9a5f-e551d6015552 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:03.676881 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7774f6a3-abe3-4b90-9a5f-e551d6015552 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:03.678294 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7774f6a3-abe3-4b90-9a5f-e551d6015552 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:03.679405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7774f6a3-abe3-4b90-9a5f-e551d6015552 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1673 microversion: 2.20 time: 0.229634 Dec 16 14:46:03.679953 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 423/822] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:03 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1673 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:46:04.510782 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1597de7b-d970-491f-b051-375b06f9ac99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:04.511331 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1597de7b-d970-491f-b051-375b06f9ac99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:04.520633 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1597de7b-d970-491f-b051-375b06f9ac99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:04.521368 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1597de7b-d970-491f-b051-375b06f9ac99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:04.522142 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1597de7b-d970-491f-b051-375b06f9ac99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:04.522572 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1597de7b-d970-491f-b051-375b06f9ac99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:04.701595 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-da2f33fd-8511-49c5-aa30-569fa0e416f8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:04.702877 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-da2f33fd-8511-49c5-aa30-569fa0e416f8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:04.716816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da2f33fd-8511-49c5-aa30-569fa0e416f8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:04.717576 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da2f33fd-8511-49c5-aa30-569fa0e416f8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:04.718974 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da2f33fd-8511-49c5-aa30-569fa0e416f8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:04.719767 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da2f33fd-8511-49c5-aa30-569fa0e416f8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:04.765042 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1597de7b-d970-491f-b051-375b06f9ac99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:04.773973 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1597de7b-d970-491f-b051-375b06f9ac99 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1758 microversion: 2.1 time: 0.266996 Dec 16 14:46:04.774537 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 400/823] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:04 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1758 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:05.001609 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-da2f33fd-8511-49c5-aa30-569fa0e416f8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:05.012486 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-da2f33fd-8511-49c5-aa30-569fa0e416f8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:05.014101 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-da2f33fd-8511-49c5-aa30-569fa0e416f8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:05.015159 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-da2f33fd-8511-49c5-aa30-569fa0e416f8 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.320728 Dec 16 14:46:05.015955 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 424/824] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:04 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:06.033450 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-28231831-2033-4300-bea2-fe3ae25604c1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:06.034423 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-28231831-2033-4300-bea2-fe3ae25604c1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:06.042061 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-28231831-2033-4300-bea2-fe3ae25604c1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:06.042549 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-28231831-2033-4300-bea2-fe3ae25604c1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:06.043126 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-28231831-2033-4300-bea2-fe3ae25604c1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:06.043566 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-28231831-2033-4300-bea2-fe3ae25604c1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:06.252361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-28231831-2033-4300-bea2-fe3ae25604c1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:06.268188 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-28231831-2033-4300-bea2-fe3ae25604c1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:06.270100 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-28231831-2033-4300-bea2-fe3ae25604c1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:06.271840 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-28231831-2033-4300-bea2-fe3ae25604c1 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.241816 Dec 16 14:46:06.272990 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 401/825] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:06 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:07.297290 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ab11da50-3897-4f17-a126-d08be5f16e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:07.298621 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ab11da50-3897-4f17-a126-d08be5f16e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:07.306691 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ab11da50-3897-4f17-a126-d08be5f16e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:07.307219 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ab11da50-3897-4f17-a126-d08be5f16e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:07.307997 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ab11da50-3897-4f17-a126-d08be5f16e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:07.308423 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ab11da50-3897-4f17-a126-d08be5f16e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:07.516398 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ab11da50-3897-4f17-a126-d08be5f16e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:07.526503 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ab11da50-3897-4f17-a126-d08be5f16e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:07.528223 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-ab11da50-3897-4f17-a126-d08be5f16e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:07.529464 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ab11da50-3897-4f17-a126-d08be5f16e95 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.236088 Dec 16 14:46:07.540965 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 425/826] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:07 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:08.547496 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-be11d0c9-b245-499e-9dea-ed37b9d72e78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:08.548197 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-be11d0c9-b245-499e-9dea-ed37b9d72e78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:08.555874 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be11d0c9-b245-499e-9dea-ed37b9d72e78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:08.556324 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be11d0c9-b245-499e-9dea-ed37b9d72e78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:08.557134 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be11d0c9-b245-499e-9dea-ed37b9d72e78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:08.557567 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be11d0c9-b245-499e-9dea-ed37b9d72e78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:08.769755 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-be11d0c9-b245-499e-9dea-ed37b9d72e78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:08.779451 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-be11d0c9-b245-499e-9dea-ed37b9d72e78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:08.780987 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-be11d0c9-b245-499e-9dea-ed37b9d72e78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:08.782103 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-be11d0c9-b245-499e-9dea-ed37b9d72e78 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.238354 Dec 16 14:46:08.782650 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 402/827] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:08 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:09.800731 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c57e2a1a-78e6-475d-9053-25555998485a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:09.802951 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c57e2a1a-78e6-475d-9053-25555998485a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:09.811038 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c57e2a1a-78e6-475d-9053-25555998485a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:09.811751 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c57e2a1a-78e6-475d-9053-25555998485a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:09.813050 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c57e2a1a-78e6-475d-9053-25555998485a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:09.813679 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c57e2a1a-78e6-475d-9053-25555998485a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:10.034553 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c57e2a1a-78e6-475d-9053-25555998485a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:10.044410 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c57e2a1a-78e6-475d-9053-25555998485a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:10.045935 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c57e2a1a-78e6-475d-9053-25555998485a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:10.047171 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c57e2a1a-78e6-475d-9053-25555998485a tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.250426 Dec 16 14:46:10.047876 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 426/828] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:09 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:46:11.064922 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1058e571-d0c6-42df-bbc1-8a18340ef6b4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:11.065565 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1058e571-d0c6-42df-bbc1-8a18340ef6b4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:11.072963 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1058e571-d0c6-42df-bbc1-8a18340ef6b4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:11.073405 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1058e571-d0c6-42df-bbc1-8a18340ef6b4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:11.074166 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1058e571-d0c6-42df-bbc1-8a18340ef6b4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:11.074597 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1058e571-d0c6-42df-bbc1-8a18340ef6b4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:11.283761 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1058e571-d0c6-42df-bbc1-8a18340ef6b4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:11.293407 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1058e571-d0c6-42df-bbc1-8a18340ef6b4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:11.294892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1058e571-d0c6-42df-bbc1-8a18340ef6b4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:11.296011 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1058e571-d0c6-42df-bbc1-8a18340ef6b4 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.234851 Dec 16 14:46:11.296835 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 403/829] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:11 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:12.314871 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-90edc189-f702-46f8-b95b-e7da8c07b211 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:12.315504 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-90edc189-f702-46f8-b95b-e7da8c07b211 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:12.323618 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-90edc189-f702-46f8-b95b-e7da8c07b211 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:12.324066 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-90edc189-f702-46f8-b95b-e7da8c07b211 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:12.324863 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-90edc189-f702-46f8-b95b-e7da8c07b211 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:12.325296 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-90edc189-f702-46f8-b95b-e7da8c07b211 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:12.536931 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-90edc189-f702-46f8-b95b-e7da8c07b211 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:12.546343 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-90edc189-f702-46f8-b95b-e7da8c07b211 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:12.548482 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-90edc189-f702-46f8-b95b-e7da8c07b211 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:12.550299 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-90edc189-f702-46f8-b95b-e7da8c07b211 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.238860 Dec 16 14:46:12.551156 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 427/830] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:12 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:13.575897 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-43b2f2ac-d098-4547-ac8a-f648fe138c8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:13.576639 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-43b2f2ac-d098-4547-ac8a-f648fe138c8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:13.584649 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43b2f2ac-d098-4547-ac8a-f648fe138c8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:13.585127 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43b2f2ac-d098-4547-ac8a-f648fe138c8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:13.585901 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43b2f2ac-d098-4547-ac8a-f648fe138c8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:13.586337 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43b2f2ac-d098-4547-ac8a-f648fe138c8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:13.795505 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-43b2f2ac-d098-4547-ac8a-f648fe138c8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:13.805344 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-43b2f2ac-d098-4547-ac8a-f648fe138c8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:13.806919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-43b2f2ac-d098-4547-ac8a-f648fe138c8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:13.808169 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-43b2f2ac-d098-4547-ac8a-f648fe138c8c tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.236424 Dec 16 14:46:13.808721 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 404/831] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:13 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:14.827216 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-67dc013d-bdbf-4e21-88bd-60a860df18b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:14.827821 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-67dc013d-bdbf-4e21-88bd-60a860df18b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:14.836036 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-67dc013d-bdbf-4e21-88bd-60a860df18b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:14.836477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-67dc013d-bdbf-4e21-88bd-60a860df18b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:14.837275 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-67dc013d-bdbf-4e21-88bd-60a860df18b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:14.837706 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-67dc013d-bdbf-4e21-88bd-60a860df18b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:15.048436 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-67dc013d-bdbf-4e21-88bd-60a860df18b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:15.057249 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-67dc013d-bdbf-4e21-88bd-60a860df18b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:15.058916 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-67dc013d-bdbf-4e21-88bd-60a860df18b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:15.060076 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-67dc013d-bdbf-4e21-88bd-60a860df18b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.237024 Dec 16 14:46:15.060639 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 428/832] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:14 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:16.078500 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6d22386d-9e3d-4ed1-abaf-036f38b10ef0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:16.079132 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6d22386d-9e3d-4ed1-abaf-036f38b10ef0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:16.087202 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d22386d-9e3d-4ed1-abaf-036f38b10ef0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:16.087642 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d22386d-9e3d-4ed1-abaf-036f38b10ef0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:16.088403 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d22386d-9e3d-4ed1-abaf-036f38b10ef0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:16.088848 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d22386d-9e3d-4ed1-abaf-036f38b10ef0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:16.294480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6d22386d-9e3d-4ed1-abaf-036f38b10ef0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:16.303626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6d22386d-9e3d-4ed1-abaf-036f38b10ef0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:16.305163 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6d22386d-9e3d-4ed1-abaf-036f38b10ef0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:16.306281 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6d22386d-9e3d-4ed1-abaf-036f38b10ef0 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.231659 Dec 16 14:46:16.306825 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 405/833] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:16 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:17.324574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-928479a0-98ec-4461-82b5-5f67f8fc5014 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:17.325222 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-928479a0-98ec-4461-82b5-5f67f8fc5014 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:17.332476 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-928479a0-98ec-4461-82b5-5f67f8fc5014 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:17.332951 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-928479a0-98ec-4461-82b5-5f67f8fc5014 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:17.333709 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-928479a0-98ec-4461-82b5-5f67f8fc5014 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:17.334138 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-928479a0-98ec-4461-82b5-5f67f8fc5014 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:17.531226 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-928479a0-98ec-4461-82b5-5f67f8fc5014 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:17.540411 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-928479a0-98ec-4461-82b5-5f67f8fc5014 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:17.541953 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-928479a0-98ec-4461-82b5-5f67f8fc5014 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:17.543067 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-928479a0-98ec-4461-82b5-5f67f8fc5014 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.222287 Dec 16 14:46:17.543616 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 429/834] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:17 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:18.560975 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8c491e49-b296-47ed-8053-fd8e2396f519 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:18.561566 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8c491e49-b296-47ed-8053-fd8e2396f519 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:18.569088 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8c491e49-b296-47ed-8053-fd8e2396f519 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:18.569529 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8c491e49-b296-47ed-8053-fd8e2396f519 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:18.570288 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8c491e49-b296-47ed-8053-fd8e2396f519 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:18.570712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8c491e49-b296-47ed-8053-fd8e2396f519 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:18.774791 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8c491e49-b296-47ed-8053-fd8e2396f519 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:18.783567 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8c491e49-b296-47ed-8053-fd8e2396f519 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:18.785091 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8c491e49-b296-47ed-8053-fd8e2396f519 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:18.786218 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8c491e49-b296-47ed-8053-fd8e2396f519 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.228941 Dec 16 14:46:18.786776 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 406/835] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:18 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:19.804677 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-318ffc22-01fc-4670-93ad-d778dc0c3402 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:19.805435 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-318ffc22-01fc-4670-93ad-d778dc0c3402 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:19.812823 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-318ffc22-01fc-4670-93ad-d778dc0c3402 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:19.813281 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-318ffc22-01fc-4670-93ad-d778dc0c3402 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:19.814072 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-318ffc22-01fc-4670-93ad-d778dc0c3402 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:19.814540 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-318ffc22-01fc-4670-93ad-d778dc0c3402 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:20.168683 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-318ffc22-01fc-4670-93ad-d778dc0c3402 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:20.177923 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-318ffc22-01fc-4670-93ad-d778dc0c3402 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:20.179421 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-318ffc22-01fc-4670-93ad-d778dc0c3402 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:20.180542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-318ffc22-01fc-4670-93ad-d778dc0c3402 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.379664 Dec 16 14:46:20.181123 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 430/836] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:19 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:20.330994 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-63125ced-0cc8-411f-9c18-065970f7c5b7 req-39b61c3a-ba4e-4242-9e88-2f6988d813d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5526fc-135b-4e73-882b-e446f2905447", "name": "network-vif-plugged", "status": "completed", "tag": "863ee071-cd68-4318-b951-baa44727d00f"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:20.332668 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:20.332668 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:46:20.347649 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-63125ced-0cc8-411f-9c18-065970f7c5b7 req-39b61c3a-ba4e-4242-9e88-2f6988d813d4 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:20.348083 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-63125ced-0cc8-411f-9c18-065970f7c5b7 req-39b61c3a-ba4e-4242-9e88-2f6988d813d4 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:20.365034 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-63125ced-0cc8-411f-9c18-065970f7c5b7 req-39b61c3a-ba4e-4242-9e88-2f6988d813d4 service nova] Creating event network-vif-plugged:863ee071-cd68-4318-b951-baa44727d00f for instance aa5526fc-135b-4e73-882b-e446f2905447 on hv-cinder-82189 Dec 16 14:46:20.370356 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-63125ced-0cc8-411f-9c18-065970f7c5b7 req-39b61c3a-ba4e-4242-9e88-2f6988d813d4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042968 Dec 16 14:46:20.371300 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 407/837] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:46:21.198547 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-717242ee-4c62-4eb9-a446-a2b06358b384 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:21.199140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-717242ee-4c62-4eb9-a446-a2b06358b384 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:21.206356 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-717242ee-4c62-4eb9-a446-a2b06358b384 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:21.206804 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-717242ee-4c62-4eb9-a446-a2b06358b384 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:21.207576 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-717242ee-4c62-4eb9-a446-a2b06358b384 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:21.208006 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-717242ee-4c62-4eb9-a446-a2b06358b384 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:21.397449 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-717242ee-4c62-4eb9-a446-a2b06358b384 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:21.406894 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-717242ee-4c62-4eb9-a446-a2b06358b384 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:21.408390 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-717242ee-4c62-4eb9-a446-a2b06358b384 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:21.409560 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-717242ee-4c62-4eb9-a446-a2b06358b384 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1731 microversion: 2.20 time: 0.214770 Dec 16 14:46:21.410118 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 431/838] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:21 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:22.428089 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-be7945ec-4e50-4e14-9aab-caf5ab21a36b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:22.428817 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-be7945ec-4e50-4e14-9aab-caf5ab21a36b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:22.436458 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be7945ec-4e50-4e14-9aab-caf5ab21a36b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:22.437070 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be7945ec-4e50-4e14-9aab-caf5ab21a36b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:22.437860 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be7945ec-4e50-4e14-9aab-caf5ab21a36b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:22.438283 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be7945ec-4e50-4e14-9aab-caf5ab21a36b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:22.634220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-be7945ec-4e50-4e14-9aab-caf5ab21a36b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:22.642858 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-be7945ec-4e50-4e14-9aab-caf5ab21a36b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:22.644350 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-be7945ec-4e50-4e14-9aab-caf5ab21a36b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:22.645569 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-be7945ec-4e50-4e14-9aab-caf5ab21a36b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1718 microversion: 2.20 time: 0.221903 Dec 16 14:46:22.646159 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 408/839] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:22 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1718 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:37.574943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2c848c66-d0c2-4338-a4ce-bb2ab4f1f3f5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-518630037"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:37.575645 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2c848c66-d0c2-4338-a4ce-bb2ab4f1f3f5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:37.582657 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2c848c66-d0c2-4338-a4ce-bb2ab4f1f3f5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:37.583093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2c848c66-d0c2-4338-a4ce-bb2ab4f1f3f5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.583842 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2c848c66-d0c2-4338-a4ce-bb2ab4f1f3f5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:37.584259 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2c848c66-d0c2-4338-a4ce-bb2ab4f1f3f5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:37.769616 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.network.security_group_api [None req-2c848c66-d0c2-4338-a4ce-bb2ab4f1f3f5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Removing security group 068455a0-72ac-4e2b-886b-7f1892d1a02f from port 66acd505-3947-431a-85d5-04918d500d6b Dec 16 14:46:38.243525 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2c848c66-d0c2-4338-a4ce-bb2ab4f1f3f5 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "POST /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/action" status: 202 len: 0 microversion: 2.1 time: 0.672357 Dec 16 14:46:38.244016 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 432/840] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:46:37 2021] POST /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:38.261179 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-e66c177d-fe5f-43ee-a3bb-c0f59354f930 req-6dc683ea-5957-4c51-9657-4f6c69a5d8ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13", "tag": "66acd505-3947-431a-85d5-04918d500d6b"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:38.263208 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:38.263208 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:46:38.274311 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-e66c177d-fe5f-43ee-a3bb-c0f59354f930 req-6dc683ea-5957-4c51-9657-4f6c69a5d8ea service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:38.276144 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-e66c177d-fe5f-43ee-a3bb-c0f59354f930 req-6dc683ea-5957-4c51-9657-4f6c69a5d8ea service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:38.306130 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-e66c177d-fe5f-43ee-a3bb-c0f59354f930 req-6dc683ea-5957-4c51-9657-4f6c69a5d8ea service nova] Creating event network-changed:66acd505-3947-431a-85d5-04918d500d6b for instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 on hv-cinder-82189 Dec 16 14:46:38.311700 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-e66c177d-fe5f-43ee-a3bb-c0f59354f930 req-6dc683ea-5957-4c51-9657-4f6c69a5d8ea service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057148 Dec 16 14:46:38.314799 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 409/841] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:46:40.289836 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4d0877b6-b4b6-407b-9e9c-5161eceedbf7 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:40.290397 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4d0877b6-b4b6-407b-9e9c-5161eceedbf7 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:40.297764 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d0877b6-b4b6-407b-9e9c-5161eceedbf7 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.298209 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d0877b6-b4b6-407b-9e9c-5161eceedbf7 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.299014 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d0877b6-b4b6-407b-9e9c-5161eceedbf7 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.299445 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4d0877b6-b4b6-407b-9e9c-5161eceedbf7 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.326258 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-1f02e353-4b52-48ce-9e32-1fbcbec1c792 req-794b90c0-150b-41db-8638-c99e242c3a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13", "tag": "66acd505-3947-431a-85d5-04918d500d6b"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:40.327919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:40.327919 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:46:40.338139 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-1f02e353-4b52-48ce-9e32-1fbcbec1c792 req-794b90c0-150b-41db-8638-c99e242c3a31 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.338139 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-1f02e353-4b52-48ce-9e32-1fbcbec1c792 req-794b90c0-150b-41db-8638-c99e242c3a31 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.354916 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-1f02e353-4b52-48ce-9e32-1fbcbec1c792 req-794b90c0-150b-41db-8638-c99e242c3a31 service nova] Creating event network-changed:66acd505-3947-431a-85d5-04918d500d6b for instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 on hv-cinder-82189 Dec 16 14:46:40.360847 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-1f02e353-4b52-48ce-9e32-1fbcbec1c792 req-794b90c0-150b-41db-8638-c99e242c3a31 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038775 Dec 16 14:46:40.361826 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 410/842] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:46:40.476541 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-4d0877b6-b4b6-407b-9e9c-5161eceedbf7 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lazy-loading 'services' on Instance uuid 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:46:40.625145 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4d0877b6-b4b6-407b-9e9c-5161eceedbf7 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/os-volume_attachments/b1d9aada-5fe8-4d4d-abfd-d903ba5c9262" status: 202 len: 0 microversion: 2.1 time: 0.338693 Dec 16 14:46:40.630666 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 433/843] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:46:40 2021] DELETE /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/os-volume_attachments/b1d9aada-5fe8-4d4d-abfd-d903ba5c9262 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:40.640021 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fb2889a6-1ce0-472f-a08b-0c9e6721b069 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:40.642123 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fb2889a6-1ce0-472f-a08b-0c9e6721b069 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:40.654101 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb2889a6-1ce0-472f-a08b-0c9e6721b069 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.654553 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb2889a6-1ce0-472f-a08b-0c9e6721b069 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.655354 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb2889a6-1ce0-472f-a08b-0c9e6721b069 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:40.656554 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb2889a6-1ce0-472f-a08b-0c9e6721b069 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:40.757118 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fb2889a6-1ce0-472f-a08b-0c9e6721b069 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123844 Dec 16 14:46:40.757995 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 411/844] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:46:40 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:46:41.771484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-84b591b7-65d6-41fa-9709-818c8bdc13c6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:41.772554 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-84b591b7-65d6-41fa-9709-818c8bdc13c6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:41.781325 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-84b591b7-65d6-41fa-9709-818c8bdc13c6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:41.781706 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-84b591b7-65d6-41fa-9709-818c8bdc13c6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:41.782487 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-84b591b7-65d6-41fa-9709-818c8bdc13c6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:41.782923 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-84b591b7-65d6-41fa-9709-818c8bdc13c6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:41.850808 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-84b591b7-65d6-41fa-9709-818c8bdc13c6 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084471 Dec 16 14:46:41.851725 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 434/845] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:46:41 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:46:41.861869 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7e51ded3-0464-42cf-ae3a-145158f08d1a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:41.862415 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7e51ded3-0464-42cf-ae3a-145158f08d1a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:41.870819 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e51ded3-0464-42cf-ae3a-145158f08d1a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:41.871266 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e51ded3-0464-42cf-ae3a-145158f08d1a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:41.872160 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e51ded3-0464-42cf-ae3a-145158f08d1a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:41.872702 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7e51ded3-0464-42cf-ae3a-145158f08d1a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:42.025449 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-7e51ded3-0464-42cf-ae3a-145158f08d1a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] HTTP exception thrown: Instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 is not attached to volume b1d9aada-5fe8-4d4d-abfd-d903ba5c9262 Dec 16 14:46:42.026040 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7e51ded3-0464-42cf-ae3a-145158f08d1a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Returning 404 to user: Instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 is not attached to volume b1d9aada-5fe8-4d4d-abfd-d903ba5c9262 {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:46:42.026880 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7e51ded3-0464-42cf-ae3a-145158f08d1a tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/os-volume_attachments/b1d9aada-5fe8-4d4d-abfd-d903ba5c9262" status: 404 len: 154 microversion: 2.1 time: 0.168965 Dec 16 14:46:42.027655 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 412/846] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:46:41 2021] DELETE /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13/os-volume_attachments/b1d9aada-5fe8-4d4d-abfd-d903ba5c9262 => generated 154 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:46:43.258520 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8f7a4fbf-b338-46d1-a3ca-acb0164b95dd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:43.259053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8f7a4fbf-b338-46d1-a3ca-acb0164b95dd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:43.266748 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8f7a4fbf-b338-46d1-a3ca-acb0164b95dd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:43.267193 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8f7a4fbf-b338-46d1-a3ca-acb0164b95dd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:43.267962 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8f7a4fbf-b338-46d1-a3ca-acb0164b95dd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:43.268403 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8f7a4fbf-b338-46d1-a3ca-acb0164b95dd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:43.472832 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8f7a4fbf-b338-46d1-a3ca-acb0164b95dd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Going to try to terminate instance {{(pid=101914) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:46:43.586547 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8f7a4fbf-b338-46d1-a3ca-acb0164b95dd tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 204 len: 0 microversion: 2.1 time: 0.331450 Dec 16 14:46:43.587269 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 435/847] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:46:43 2021] DELETE /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:46:43.597782 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-559d00d8-3c1c-489c-942b-fff6ee037961 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:43.598411 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-559d00d8-3c1c-489c-942b-fff6ee037961 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:43.605885 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-559d00d8-3c1c-489c-942b-fff6ee037961 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:43.606330 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-559d00d8-3c1c-489c-942b-fff6ee037961 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:43.607098 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-559d00d8-3c1c-489c-942b-fff6ee037961 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:43.607531 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-559d00d8-3c1c-489c-942b-fff6ee037961 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:43.825660 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-559d00d8-3c1c-489c-942b-fff6ee037961 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:43.834481 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-559d00d8-3c1c-489c-942b-fff6ee037961 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1553 microversion: 2.1 time: 0.240787 Dec 16 14:46:43.835308 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 413/848] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:43 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:44.851943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e5567d89-3b25-49ba-ae38-f0be81d64262 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:44.852641 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e5567d89-3b25-49ba-ae38-f0be81d64262 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:44.860518 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e5567d89-3b25-49ba-ae38-f0be81d64262 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:44.861149 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e5567d89-3b25-49ba-ae38-f0be81d64262 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:44.861915 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e5567d89-3b25-49ba-ae38-f0be81d64262 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:44.862344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e5567d89-3b25-49ba-ae38-f0be81d64262 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:45.059763 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e5567d89-3b25-49ba-ae38-f0be81d64262 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:45.067959 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e5567d89-3b25-49ba-ae38-f0be81d64262 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1553 microversion: 2.1 time: 0.220143 Dec 16 14:46:45.068513 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 436/849] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:44 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:46.084498 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-de6659d7-e3b0-4261-8ef4-236fae5110c0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:46.085145 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-de6659d7-e3b0-4261-8ef4-236fae5110c0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:46.092910 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de6659d7-e3b0-4261-8ef4-236fae5110c0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:46.093361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de6659d7-e3b0-4261-8ef4-236fae5110c0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:46.094128 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de6659d7-e3b0-4261-8ef4-236fae5110c0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:46.094565 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de6659d7-e3b0-4261-8ef4-236fae5110c0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:46.315329 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-de6659d7-e3b0-4261-8ef4-236fae5110c0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c993a63eecd0427bb688f1fd6d435168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b1e0c2f8144613a8e65e6b0e208a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:46.324138 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-de6659d7-e3b0-4261-8ef4-236fae5110c0 tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 200 len: 1553 microversion: 2.1 time: 0.242754 Dec 16 14:46:46.324700 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 414/850] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:46 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:46:46.367521 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-1198e918-adeb-461b-8b85-a4f418bac4e4 req-3e4e33e4-ff27-47a0-94a3-2c2cbc696bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13", "name": "network-vif-deleted", "tag": "66acd505-3947-431a-85d5-04918d500d6b"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:46.369199 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:46.369199 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:46:46.377873 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-1198e918-adeb-461b-8b85-a4f418bac4e4 req-3e4e33e4-ff27-47a0-94a3-2c2cbc696bc0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:46.378307 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-1198e918-adeb-461b-8b85-a4f418bac4e4 req-3e4e33e4-ff27-47a0-94a3-2c2cbc696bc0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:46.394900 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-1198e918-adeb-461b-8b85-a4f418bac4e4 req-3e4e33e4-ff27-47a0-94a3-2c2cbc696bc0 service nova] Creating event network-vif-deleted:66acd505-3947-431a-85d5-04918d500d6b for instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 on hv-cinder-82189 Dec 16 14:46:46.399487 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-1198e918-adeb-461b-8b85-a4f418bac4e4 req-3e4e33e4-ff27-47a0-94a3-2c2cbc696bc0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035520 Dec 16 14:46:46.400067 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 437/851] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:46:47.341126 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3826d0d9-c421-4ebc-ae28-6ce3837284ef tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:47.341729 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3826d0d9-c421-4ebc-ae28-6ce3837284ef tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] [instance: 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:47.349429 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3826d0d9-c421-4ebc-ae28-6ce3837284ef tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:47.349898 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3826d0d9-c421-4ebc-ae28-6ce3837284ef tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:47.350649 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3826d0d9-c421-4ebc-ae28-6ce3837284ef tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:47.351087 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3826d0d9-c421-4ebc-ae28-6ce3837284ef tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:47.399917 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-3826d0d9-c421-4ebc-ae28-6ce3837284ef tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] HTTP exception thrown: Instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 could not be found. Dec 16 14:46:47.400511 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3826d0d9-c421-4ebc-ae28-6ce3837284ef tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Returning 404 to user: Instance 4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:46:47.401361 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3826d0d9-c421-4ebc-ae28-6ce3837284ef tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13" status: 404 len: 111 microversion: 2.1 time: 0.064619 Dec 16 14:46:47.402555 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 415/852] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:46:47 2021] GET /compute/v2.1/servers/4dfeb081-8ade-4c82-b80e-cb1a4fb1ac13 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:46:47.411742 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-123b3666-5cb2-4857-967f-2846ec290fdc tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] Calling method '.version_select at 0x7f3c2c5d8430>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:47.428595 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-123b3666-5cb2-4857-967f-2846ec290fdc tempest-TestMinimumBasicScenario-395457342 tempest-TestMinimumBasicScenario-395457342-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1816150922" status: 202 len: 0 microversion: 2.1 time: 0.021050 Dec 16 14:46:47.429179 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 438/853] 10.222.0.64 () {58 vars in 1271 bytes} [Thu Dec 16 14:46:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1816150922 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:46:55.177002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-02a66b50-d1ac-4391-912e-e6c5ae5b744d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:55.177959 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-02a66b50-d1ac-4391-912e-e6c5ae5b744d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:55.185996 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-02a66b50-d1ac-4391-912e-e6c5ae5b744d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:55.186454 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-02a66b50-d1ac-4391-912e-e6c5ae5b744d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.187202 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-02a66b50-d1ac-4391-912e-e6c5ae5b744d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:55.187629 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-02a66b50-d1ac-4391-912e-e6c5ae5b744d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.251631 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-02a66b50-d1ac-4391-912e-e6c5ae5b744d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.078305 Dec 16 14:46:55.252209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 416/854] 10.222.0.64 () {60 vars in 1342 bytes} [Thu Dec 16 14:46:55 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:46:55.354340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-81596f18-91b2-4ea4-98d2-aab2c1502788 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:55.354940 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-81596f18-91b2-4ea4-98d2-aab2c1502788 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:55.362973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-81596f18-91b2-4ea4-98d2-aab2c1502788 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:55.363417 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-81596f18-91b2-4ea4-98d2-aab2c1502788 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.364193 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-81596f18-91b2-4ea4-98d2-aab2c1502788 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:55.364624 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-81596f18-91b2-4ea4-98d2-aab2c1502788 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.427416 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-81596f18-91b2-4ea4-98d2-aab2c1502788 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Going to try to terminate instance {{(pid=101914) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:46:55.539832 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-81596f18-91b2-4ea4-98d2-aab2c1502788 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 204 len: 0 microversion: 2.20 time: 0.188865 Dec 16 14:46:55.540669 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 439/855] 10.222.0.64 () {60 vars in 1279 bytes} [Thu Dec 16 14:46:55 2021] DELETE /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:46:55.549391 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9d68011d-2954-41eb-9f54-16ac2acf65e2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:55.549995 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9d68011d-2954-41eb-9f54-16ac2acf65e2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:55.557730 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d68011d-2954-41eb-9f54-16ac2acf65e2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:55.558184 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d68011d-2954-41eb-9f54-16ac2acf65e2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.558968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d68011d-2954-41eb-9f54-16ac2acf65e2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:55.560021 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9d68011d-2954-41eb-9f54-16ac2acf65e2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:55.962865 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9d68011d-2954-41eb-9f54-16ac2acf65e2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:55.972170 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9d68011d-2954-41eb-9f54-16ac2acf65e2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:55.973815 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9d68011d-2954-41eb-9f54-16ac2acf65e2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:55.975056 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9d68011d-2954-41eb-9f54-16ac2acf65e2 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.429363 Dec 16 14:46:55.976048 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 417/856] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:55 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:56.994056 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-acf0c94a-70bb-4ee0-aa24-1c8780b62d6d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:56.994768 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-acf0c94a-70bb-4ee0-aa24-1c8780b62d6d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:57.002210 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-acf0c94a-70bb-4ee0-aa24-1c8780b62d6d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:57.002659 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-acf0c94a-70bb-4ee0-aa24-1c8780b62d6d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:57.003426 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-acf0c94a-70bb-4ee0-aa24-1c8780b62d6d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:57.003857 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-acf0c94a-70bb-4ee0-aa24-1c8780b62d6d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:57.334230 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-acf0c94a-70bb-4ee0-aa24-1c8780b62d6d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:57.344669 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-acf0c94a-70bb-4ee0-aa24-1c8780b62d6d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:57.346987 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-acf0c94a-70bb-4ee0-aa24-1c8780b62d6d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:57.348483 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-acf0c94a-70bb-4ee0-aa24-1c8780b62d6d tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1724 microversion: 2.20 time: 0.358727 Dec 16 14:46:57.349232 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 440/857] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:56 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:58.367667 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1a6c743f-7487-4d44-91da-5af061e611ef tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:58.369031 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1a6c743f-7487-4d44-91da-5af061e611ef tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:58.376693 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1a6c743f-7487-4d44-91da-5af061e611ef tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:58.377235 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1a6c743f-7487-4d44-91da-5af061e611ef tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:58.378075 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1a6c743f-7487-4d44-91da-5af061e611ef tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:58.378571 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1a6c743f-7487-4d44-91da-5af061e611ef tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:58.516497 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1a6c743f-7487-4d44-91da-5af061e611ef tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:58.525921 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1a6c743f-7487-4d44-91da-5af061e611ef tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:58.527064 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-1a6c743f-7487-4d44-91da-5af061e611ef tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18d85bcc0aeb413aa2ade769fd10e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '431320546381414684830eb2bc36deef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:46:58.528179 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1a6c743f-7487-4d44-91da-5af061e611ef tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 200 len: 1656 microversion: 2.20 time: 0.164793 Dec 16 14:46:58.529652 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 418/858] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:58 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 1656 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:46:58.713126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-b1916d51-371a-4938-959e-d192ec91a78d req-ee35d606-e95c-49c6-9891-60b12ce1d4ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5526fc-135b-4e73-882b-e446f2905447", "name": "network-vif-deleted", "tag": "863ee071-cd68-4318-b951-baa44727d00f"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:46:58.719753 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:46:58.719753 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:46:58.733211 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-b1916d51-371a-4938-959e-d192ec91a78d req-ee35d606-e95c-49c6-9891-60b12ce1d4ed service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:58.734704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-b1916d51-371a-4938-959e-d192ec91a78d req-ee35d606-e95c-49c6-9891-60b12ce1d4ed service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:58.759049 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-b1916d51-371a-4938-959e-d192ec91a78d req-ee35d606-e95c-49c6-9891-60b12ce1d4ed service nova] Creating event network-vif-deleted:863ee071-cd68-4318-b951-baa44727d00f for instance aa5526fc-135b-4e73-882b-e446f2905447 on hv-cinder-82189 Dec 16 14:46:58.770467 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-b1916d51-371a-4938-959e-d192ec91a78d req-ee35d606-e95c-49c6-9891-60b12ce1d4ed service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063400 Dec 16 14:46:58.772271 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 441/859] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:46:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:46:59.546942 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7de61921-5d6a-4f88-89e7-7e3b6ae781bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:59.547643 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7de61921-5d6a-4f88-89e7-7e3b6ae781bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:46:59.556521 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7de61921-5d6a-4f88-89e7-7e3b6ae781bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:59.557098 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7de61921-5d6a-4f88-89e7-7e3b6ae781bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:59.558453 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7de61921-5d6a-4f88-89e7-7e3b6ae781bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:46:59.558453 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7de61921-5d6a-4f88-89e7-7e3b6ae781bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:46:59.609573 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-7de61921-5d6a-4f88-89e7-7e3b6ae781bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] HTTP exception thrown: Instance aa5526fc-135b-4e73-882b-e446f2905447 could not be found. Dec 16 14:46:59.610291 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7de61921-5d6a-4f88-89e7-7e3b6ae781bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Returning 404 to user: Instance aa5526fc-135b-4e73-882b-e446f2905447 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:46:59.611269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7de61921-5d6a-4f88-89e7-7e3b6ae781bb tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 404 len: 111 microversion: 2.20 time: 0.068049 Dec 16 14:46:59.612017 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 419/860] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:46:59 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:46:59.621217 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c06238c8-00bc-4abf-8a4f-541f74ace4b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '.version_select at 0x7f3c2d705d30>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:46:59.642895 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c06238c8-00bc-4abf-8a4f-541f74ace4b9 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476088998" status: 204 len: 0 microversion: 2.20 time: 0.025955 Dec 16 14:46:59.643667 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 442/861] 10.222.0.64 () {60 vars in 1261 bytes} [Thu Dec 16 14:46:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476088998 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 16 14:47:02.993974 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9a0eb56c-fdd5-465f-a78b-be5736196c4b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:02.994449 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9a0eb56c-fdd5-465f-a78b-be5736196c4b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:03.001898 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9a0eb56c-fdd5-465f-a78b-be5736196c4b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:03.002344 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9a0eb56c-fdd5-465f-a78b-be5736196c4b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:03.003104 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9a0eb56c-fdd5-465f-a78b-be5736196c4b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:03.003538 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9a0eb56c-fdd5-465f-a78b-be5736196c4b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:03.052574 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-9a0eb56c-fdd5-465f-a78b-be5736196c4b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] HTTP exception thrown: Instance aa5526fc-135b-4e73-882b-e446f2905447 could not be found. Dec 16 14:47:03.053181 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9a0eb56c-fdd5-465f-a78b-be5736196c4b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Returning 404 to user: Instance aa5526fc-135b-4e73-882b-e446f2905447 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:47:03.053995 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9a0eb56c-fdd5-465f-a78b-be5736196c4b tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 404 len: 111 microversion: 2.20 time: 0.063783 Dec 16 14:47:03.054535 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 420/862] 10.222.0.64 () {60 vars in 1279 bytes} [Thu Dec 16 14:47:02 2021] DELETE /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:47:03.062401 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4538c85a-30a8-477d-85d0-7fa1c7f84fe7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:03.063133 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4538c85a-30a8-477d-85d0-7fa1c7f84fe7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: aa5526fc-135b-4e73-882b-e446f2905447] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:03.070516 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4538c85a-30a8-477d-85d0-7fa1c7f84fe7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:03.070970 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4538c85a-30a8-477d-85d0-7fa1c7f84fe7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:03.071737 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4538c85a-30a8-477d-85d0-7fa1c7f84fe7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:03.072174 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4538c85a-30a8-477d-85d0-7fa1c7f84fe7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:03.122458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-4538c85a-30a8-477d-85d0-7fa1c7f84fe7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] HTTP exception thrown: Instance aa5526fc-135b-4e73-882b-e446f2905447 could not be found. Dec 16 14:47:03.123039 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4538c85a-30a8-477d-85d0-7fa1c7f84fe7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Returning 404 to user: Instance aa5526fc-135b-4e73-882b-e446f2905447 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:47:03.123847 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4538c85a-30a8-477d-85d0-7fa1c7f84fe7 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447" status: 404 len: 111 microversion: 2.20 time: 0.065268 Dec 16 14:47:03.124376 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 443/863] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:47:03 2021] GET /compute/v2.1/servers/aa5526fc-135b-4e73-882b-e446f2905447 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:47:04.362337 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b6a6690b-74e6-4e35-9ccc-1a2d3f88fea5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:04.362837 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b6a6690b-74e6-4e35-9ccc-1a2d3f88fea5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:04.370090 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b6a6690b-74e6-4e35-9ccc-1a2d3f88fea5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:04.370537 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b6a6690b-74e6-4e35-9ccc-1a2d3f88fea5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:04.371303 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b6a6690b-74e6-4e35-9ccc-1a2d3f88fea5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:04.371737 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b6a6690b-74e6-4e35-9ccc-1a2d3f88fea5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:04.423779 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-b6a6690b-74e6-4e35-9ccc-1a2d3f88fea5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] HTTP exception thrown: Instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 could not be found. Dec 16 14:47:04.424366 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b6a6690b-74e6-4e35-9ccc-1a2d3f88fea5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Returning 404 to user: Instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:47:04.425209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b6a6690b-74e6-4e35-9ccc-1a2d3f88fea5 tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 404 len: 111 microversion: 2.20 time: 0.066554 Dec 16 14:47:04.425752 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 421/864] 10.222.0.64 () {60 vars in 1279 bytes} [Thu Dec 16 14:47:04 2021] DELETE /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:47:04.433586 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f3c70053-6374-4de7-82a1-ef6a343c17cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:04.434194 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f3c70053-6374-4de7-82a1-ef6a343c17cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] [instance: a1e7a3c6-dc99-4927-83c2-dd8ba87239b2] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:04.441609 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3c70053-6374-4de7-82a1-ef6a343c17cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:04.442063 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3c70053-6374-4de7-82a1-ef6a343c17cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:04.442828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3c70053-6374-4de7-82a1-ef6a343c17cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:04.443261 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f3c70053-6374-4de7-82a1-ef6a343c17cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:04.492078 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-f3c70053-6374-4de7-82a1-ef6a343c17cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] HTTP exception thrown: Instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 could not be found. Dec 16 14:47:04.492668 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f3c70053-6374-4de7-82a1-ef6a343c17cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] Returning 404 to user: Instance a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:47:04.493512 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f3c70053-6374-4de7-82a1-ef6a343c17cf tempest-AttachVolumeShelveTestJSON-441510440 tempest-AttachVolumeShelveTestJSON-441510440-project] 10.222.0.64 "GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2" status: 404 len: 111 microversion: 2.20 time: 0.063670 Dec 16 14:47:04.494060 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 444/865] 10.222.0.64 () {60 vars in 1276 bytes} [Thu Dec 16 14:47:04 2021] GET /compute/v2.1/servers/a1e7a3c6-dc99-4927-83c2-dd8ba87239b2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:47:16.954297 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-75cbeaa1-6046-4f0b-bca3-0488c7c19f0e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'create', calling method: .version_select at 0x7f3c2c255e50>, body: {"keypair": {"name": "tempest-keypair-931247866"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:16.979465 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-75cbeaa1-6046-4f0b-bca3-0488c7c19f0e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'key_pairs'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:47:16.983223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-75cbeaa1-6046-4f0b-bca3-0488c7c19f0e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for user 48319d5dcda64acebea9bb3daad1889b and project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'key_pairs'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:47:17.222303 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-75cbeaa1-6046-4f0b-bca3-0488c7c19f0e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'key_pairs'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:47:17.226079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-75cbeaa1-6046-4f0b-bca3-0488c7c19f0e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for user 48319d5dcda64acebea9bb3daad1889b and project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'key_pairs'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:47:17.238721 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-75cbeaa1-6046-4f0b-bca3-0488c7c19f0e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.416525 Dec 16 14:47:17.239237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 422/866] 10.222.0.64 () {60 vars in 1157 bytes} [Thu Dec 16 14:47:16 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:19.093233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-175055494", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e2c3c82-d885-4e17-97cb-7ea9c8e597d5"}], "security_groups": [{"name": "tempest-securitygroup--1622071242"}], "key_name": "tempest-keypair-931247866", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:19.117396 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d989187-3e87-46c2-8fd9-84acac2d774c] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 14:47:19.238957 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.network.neutron [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] validate_networks() for [('8e2c3c82-d885-4e17-97cb-7ea9c8e597d5', None, None, None)] {{(pid=101914) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:47:20.071605 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Flavor limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:47:20.072029 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Image limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:47:20.072500 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Flavor pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:47:20.072988 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Image pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:47:20.073439 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:47:20.084039 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:20.084768 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:20.085712 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:20.086385 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:20.104363 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:47:20.108964 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for user 48319d5dcda64acebea9bb3daad1889b and project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:47:20.139325 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d989187-3e87-46c2-8fd9-84acac2d774c] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 57424. Dec 16 14:47:20.141951 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Going to run 1 instances... {{(pid=101914) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:47:20.144571 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:47:20.210706 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c21393a1-d643-4647-9624-9002f61b8f59 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.124447 Dec 16 14:47:20.211343 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 445/867] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:47:19 2021] POST /compute/v2.1/servers => generated 402 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:47:20.218971 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8f475ad-ad4a-422f-83ac-7c24244cd8bc] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 14:47:20.222946 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-346d375a-4d56-48e4-8259-10fef9c8d039 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:20.223826 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-346d375a-4d56-48e4-8259-10fef9c8d039 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:20.359415 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-346d375a-4d56-48e4-8259-10fef9c8d039 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:20.370227 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-346d375a-4d56-48e4-8259-10fef9c8d039 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1236 microversion: 2.1 time: 0.152650 Dec 16 14:47:20.370830 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 423/868] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:20 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1236 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:21.388328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a1e61e6a-884e-4484-86bb-d9cf78a72ea9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:21.389877 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a1e61e6a-884e-4484-86bb-d9cf78a72ea9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:21.399785 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a1e61e6a-884e-4484-86bb-d9cf78a72ea9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:21.400222 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a1e61e6a-884e-4484-86bb-d9cf78a72ea9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:21.401030 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a1e61e6a-884e-4484-86bb-d9cf78a72ea9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:21.401455 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a1e61e6a-884e-4484-86bb-d9cf78a72ea9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:21.527068 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a1e61e6a-884e-4484-86bb-d9cf78a72ea9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:21.536958 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a1e61e6a-884e-4484-86bb-d9cf78a72ea9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1296 microversion: 2.1 time: 0.152736 Dec 16 14:47:21.537522 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 446/869] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:21 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1296 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:22.554265 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2cac66d6-a7f0-42fa-a8c3-b42d8cf285b5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:22.555640 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2cac66d6-a7f0-42fa-a8c3-b42d8cf285b5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:22.580098 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8f475ad-ad4a-422f-83ac-7c24244cd8bc] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 57444. Dec 16 14:47:22.582745 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2cac66d6-a7f0-42fa-a8c3-b42d8cf285b5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:22.583180 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2cac66d6-a7f0-42fa-a8c3-b42d8cf285b5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:22.583963 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2cac66d6-a7f0-42fa-a8c3-b42d8cf285b5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:22.584397 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2cac66d6-a7f0-42fa-a8c3-b42d8cf285b5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:22.786754 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2cac66d6-a7f0-42fa-a8c3-b42d8cf285b5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:22.795304 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2cac66d6-a7f0-42fa-a8c3-b42d8cf285b5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1362 microversion: 2.1 time: 0.245009 Dec 16 14:47:22.795879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 424/870] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:22 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:22.968619 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-579ee544-7540-477b-93f2-436001d6a09c tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:22.969887 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-579ee544-7540-477b-93f2-436001d6a09c tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:22.977188 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-579ee544-7540-477b-93f2-436001d6a09c tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:22.977639 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-579ee544-7540-477b-93f2-436001d6a09c tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:22.978409 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-579ee544-7540-477b-93f2-436001d6a09c tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:22.978843 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-579ee544-7540-477b-93f2-436001d6a09c tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:23.038399 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-579ee544-7540-477b-93f2-436001d6a09c tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lazy-loading 'flavor' on Instance uuid e10a0f8d-4ce2-4f76-bdee-a88622ecf459 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:47:23.194140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-579ee544-7540-477b-93f2-436001d6a09c tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "POST /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459/action" status: 202 len: 0 microversion: 2.1 time: 0.228931 Dec 16 14:47:23.194750 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 447/871] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:22 2021] POST /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:23.203074 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-aceef277-31a0-4a19-95f3-f48ebd39b00d tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:23.203959 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-aceef277-31a0-4a19-95f3-f48ebd39b00d tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:23.211888 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aceef277-31a0-4a19-95f3-f48ebd39b00d tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:23.212553 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aceef277-31a0-4a19-95f3-f48ebd39b00d tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:23.213366 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aceef277-31a0-4a19-95f3-f48ebd39b00d tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:23.213957 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aceef277-31a0-4a19-95f3-f48ebd39b00d tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:23.425700 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-aceef277-31a0-4a19-95f3-f48ebd39b00d tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:23.434216 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-aaffbaa0-e8b3-4ae0-bc29-b3a182cea34f req-993b91f2-6737-4f6d-b1d6-be5ad6894192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21eb2e8-5685-4000-b8c6-edb7fb5daa68", "tag": "71ec40cc-e92b-4e94-8b04-7b26de75bfbb"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:23.435441 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:47:23.435441 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:47:23.443883 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-aaffbaa0-e8b3-4ae0-bc29-b3a182cea34f req-993b91f2-6737-4f6d-b1d6-be5ad6894192 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:23.444644 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-aaffbaa0-e8b3-4ae0-bc29-b3a182cea34f req-993b91f2-6737-4f6d-b1d6-be5ad6894192 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:23.465462 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-aceef277-31a0-4a19-95f3-f48ebd39b00d tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.265219 Dec 16 14:47:23.465462 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 425/872] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:23 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:23.474131 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-aaffbaa0-e8b3-4ae0-bc29-b3a182cea34f req-993b91f2-6737-4f6d-b1d6-be5ad6894192 service nova] Creating event network-changed:71ec40cc-e92b-4e94-8b04-7b26de75bfbb for instance e21eb2e8-5685-4000-b8c6-edb7fb5daa68 on hv-cinder-82189 Dec 16 14:47:23.479503 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-aaffbaa0-e8b3-4ae0-bc29-b3a182cea34f req-993b91f2-6737-4f6d-b1d6-be5ad6894192 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049756 Dec 16 14:47:23.480101 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 448/873] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:47:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:23.812617 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5aa7ca22-af3d-486d-bd0e-5baca971aa39 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:23.814691 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5aa7ca22-af3d-486d-bd0e-5baca971aa39 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:23.822656 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5aa7ca22-af3d-486d-bd0e-5baca971aa39 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:23.823111 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5aa7ca22-af3d-486d-bd0e-5baca971aa39 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:23.823892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5aa7ca22-af3d-486d-bd0e-5baca971aa39 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:23.824327 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5aa7ca22-af3d-486d-bd0e-5baca971aa39 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.022323 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5aa7ca22-af3d-486d-bd0e-5baca971aa39 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:24.030437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5aa7ca22-af3d-486d-bd0e-5baca971aa39 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1362 microversion: 2.1 time: 0.222079 Dec 16 14:47:24.030995 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 426/874] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:23 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:24.483057 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f9564ca0-20fd-4422-98c4-27810ab8bf99 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:24.483752 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f9564ca0-20fd-4422-98c4-27810ab8bf99 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:24.491939 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f9564ca0-20fd-4422-98c4-27810ab8bf99 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:24.492626 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f9564ca0-20fd-4422-98c4-27810ab8bf99 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.493451 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f9564ca0-20fd-4422-98c4-27810ab8bf99 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:24.494007 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f9564ca0-20fd-4422-98c4-27810ab8bf99 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:24.691807 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f9564ca0-20fd-4422-98c4-27810ab8bf99 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:24.700040 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f9564ca0-20fd-4422-98c4-27810ab8bf99 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.221087 Dec 16 14:47:24.700594 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 449/875] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:24 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:25.048086 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7965bac7-003d-4c83-b30b-0d2ef2df4505 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:25.048691 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7965bac7-003d-4c83-b30b-0d2ef2df4505 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:25.056090 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7965bac7-003d-4c83-b30b-0d2ef2df4505 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:25.056549 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7965bac7-003d-4c83-b30b-0d2ef2df4505 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:25.057348 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7965bac7-003d-4c83-b30b-0d2ef2df4505 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:25.057822 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7965bac7-003d-4c83-b30b-0d2ef2df4505 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:25.260209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7965bac7-003d-4c83-b30b-0d2ef2df4505 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:25.268364 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7965bac7-003d-4c83-b30b-0d2ef2df4505 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1362 microversion: 2.1 time: 0.224459 Dec 16 14:47:25.269516 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 427/876] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:25 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:25.718160 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c8cd8704-a275-4958-b0f4-497a7ba43ce1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:25.718750 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c8cd8704-a275-4958-b0f4-497a7ba43ce1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:25.726664 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c8cd8704-a275-4958-b0f4-497a7ba43ce1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:25.727153 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c8cd8704-a275-4958-b0f4-497a7ba43ce1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:25.727921 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c8cd8704-a275-4958-b0f4-497a7ba43ce1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:25.728497 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c8cd8704-a275-4958-b0f4-497a7ba43ce1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:25.928478 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c8cd8704-a275-4958-b0f4-497a7ba43ce1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:25.937479 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c8cd8704-a275-4958-b0f4-497a7ba43ce1 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.223235 Dec 16 14:47:25.938033 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 450/877] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:25 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:26.284537 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-87db6ab9-6d74-45f9-8609-55353f5f3df8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:26.285173 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-87db6ab9-6d74-45f9-8609-55353f5f3df8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:26.292986 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87db6ab9-6d74-45f9-8609-55353f5f3df8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:26.293428 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87db6ab9-6d74-45f9-8609-55353f5f3df8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:26.294178 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87db6ab9-6d74-45f9-8609-55353f5f3df8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:26.294603 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-87db6ab9-6d74-45f9-8609-55353f5f3df8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:26.488726 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-87db6ab9-6d74-45f9-8609-55353f5f3df8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:26.497086 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-87db6ab9-6d74-45f9-8609-55353f5f3df8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1362 microversion: 2.1 time: 0.216404 Dec 16 14:47:26.497644 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 428/878] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:26 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:26.954794 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-48cace5d-340c-4431-8fff-d9d594e6e611 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:26.955391 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-48cace5d-340c-4431-8fff-d9d594e6e611 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:26.962678 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-48cace5d-340c-4431-8fff-d9d594e6e611 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:26.963126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-48cace5d-340c-4431-8fff-d9d594e6e611 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:26.963889 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-48cace5d-340c-4431-8fff-d9d594e6e611 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:26.964322 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-48cace5d-340c-4431-8fff-d9d594e6e611 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:27.154319 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-48cace5d-340c-4431-8fff-d9d594e6e611 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:27.163389 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-48cace5d-340c-4431-8fff-d9d594e6e611 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.212755 Dec 16 14:47:27.163850 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 451/879] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:26 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:27.513849 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3da4e637-6802-4f0c-99da-74005218fe94 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:27.514495 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3da4e637-6802-4f0c-99da-74005218fe94 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:27.522445 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3da4e637-6802-4f0c-99da-74005218fe94 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:27.522896 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3da4e637-6802-4f0c-99da-74005218fe94 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:27.523664 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3da4e637-6802-4f0c-99da-74005218fe94 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:27.524098 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3da4e637-6802-4f0c-99da-74005218fe94 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:27.732135 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-3da4e637-6802-4f0c-99da-74005218fe94 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:27.740729 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3da4e637-6802-4f0c-99da-74005218fe94 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1362 microversion: 2.1 time: 0.230567 Dec 16 14:47:27.741330 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 429/880] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:27 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:28.180093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-14887666-894c-4ba6-930c-895b024bc244 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:28.180632 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-14887666-894c-4ba6-930c-895b024bc244 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:28.187858 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-14887666-894c-4ba6-930c-895b024bc244 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:28.188307 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-14887666-894c-4ba6-930c-895b024bc244 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:28.189101 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-14887666-894c-4ba6-930c-895b024bc244 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:28.189535 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-14887666-894c-4ba6-930c-895b024bc244 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:28.386042 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-14887666-894c-4ba6-930c-895b024bc244 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:28.394616 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-14887666-894c-4ba6-930c-895b024bc244 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.218279 Dec 16 14:47:28.395179 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 452/881] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:28 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:28.757705 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ca2b0113-17a1-443a-b4c1-d4ded480ff9e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:28.758317 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ca2b0113-17a1-443a-b4c1-d4ded480ff9e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:28.765623 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ca2b0113-17a1-443a-b4c1-d4ded480ff9e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:28.766075 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ca2b0113-17a1-443a-b4c1-d4ded480ff9e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:28.767483 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ca2b0113-17a1-443a-b4c1-d4ded480ff9e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:28.767922 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ca2b0113-17a1-443a-b4c1-d4ded480ff9e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:28.961127 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ca2b0113-17a1-443a-b4c1-d4ded480ff9e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:28.969597 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ca2b0113-17a1-443a-b4c1-d4ded480ff9e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1362 microversion: 2.1 time: 0.215565 Dec 16 14:47:28.970333 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 430/882] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:28 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:29.411723 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7f5e6d04-199f-46fb-ba60-f9d9c1710688 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:29.412326 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7f5e6d04-199f-46fb-ba60-f9d9c1710688 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:29.419646 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f5e6d04-199f-46fb-ba60-f9d9c1710688 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:29.420093 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f5e6d04-199f-46fb-ba60-f9d9c1710688 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:29.420893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f5e6d04-199f-46fb-ba60-f9d9c1710688 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:29.421327 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7f5e6d04-199f-46fb-ba60-f9d9c1710688 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:29.621695 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-7f5e6d04-199f-46fb-ba60-f9d9c1710688 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:29.629871 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7f5e6d04-199f-46fb-ba60-f9d9c1710688 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.222054 Dec 16 14:47:29.630430 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 453/883] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:29 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:29.986338 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-147047d6-d3a2-466d-aec3-67f73aaef8fe tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:29.987079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-147047d6-d3a2-466d-aec3-67f73aaef8fe tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:29.994437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-147047d6-d3a2-466d-aec3-67f73aaef8fe tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:29.994884 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-147047d6-d3a2-466d-aec3-67f73aaef8fe tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:29.995642 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-147047d6-d3a2-466d-aec3-67f73aaef8fe tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:29.996072 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-147047d6-d3a2-466d-aec3-67f73aaef8fe tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:30.187058 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-147047d6-d3a2-466d-aec3-67f73aaef8fe tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:30.195741 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-147047d6-d3a2-466d-aec3-67f73aaef8fe tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1362 microversion: 2.1 time: 0.213176 Dec 16 14:47:30.196303 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 431/884] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:29 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:30.646979 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-654a02e8-278a-4e27-b5fe-9aa5ae1e9993 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:30.647743 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-654a02e8-278a-4e27-b5fe-9aa5ae1e9993 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:30.655311 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-654a02e8-278a-4e27-b5fe-9aa5ae1e9993 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:30.655727 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-654a02e8-278a-4e27-b5fe-9aa5ae1e9993 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:30.656892 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-654a02e8-278a-4e27-b5fe-9aa5ae1e9993 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:30.657271 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-654a02e8-278a-4e27-b5fe-9aa5ae1e9993 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:30.663818 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-e4dcb5c9-c0c3-42a2-b55b-14c5aff79186 req-6adb82b6-6789-4fc6-a903-9c61e3a1e771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21eb2e8-5685-4000-b8c6-edb7fb5daa68", "name": "network-vif-plugged", "status": "completed", "tag": "71ec40cc-e92b-4e94-8b04-7b26de75bfbb"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:30.666129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:47:30.666129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:47:30.686767 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-e4dcb5c9-c0c3-42a2-b55b-14c5aff79186 req-6adb82b6-6789-4fc6-a903-9c61e3a1e771 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:30.687216 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-e4dcb5c9-c0c3-42a2-b55b-14c5aff79186 req-6adb82b6-6789-4fc6-a903-9c61e3a1e771 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:30.708799 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-e4dcb5c9-c0c3-42a2-b55b-14c5aff79186 req-6adb82b6-6789-4fc6-a903-9c61e3a1e771 service nova] Creating event network-vif-plugged:71ec40cc-e92b-4e94-8b04-7b26de75bfbb for instance e21eb2e8-5685-4000-b8c6-edb7fb5daa68 on hv-cinder-82189 Dec 16 14:47:30.714278 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-e4dcb5c9-c0c3-42a2-b55b-14c5aff79186 req-6adb82b6-6789-4fc6-a903-9c61e3a1e771 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054275 Dec 16 14:47:30.715049 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 432/885] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:47:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:47:30.970589 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-654a02e8-278a-4e27-b5fe-9aa5ae1e9993 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:30.978774 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-654a02e8-278a-4e27-b5fe-9aa5ae1e9993 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.335473 Dec 16 14:47:30.979340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 454/886] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:30 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:31.213067 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9872293a-62ce-4dc7-8ee2-39053c2508b0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:31.213763 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9872293a-62ce-4dc7-8ee2-39053c2508b0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:31.221246 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9872293a-62ce-4dc7-8ee2-39053c2508b0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:31.221689 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9872293a-62ce-4dc7-8ee2-39053c2508b0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:31.222441 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9872293a-62ce-4dc7-8ee2-39053c2508b0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:31.222867 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9872293a-62ce-4dc7-8ee2-39053c2508b0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:31.416920 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9872293a-62ce-4dc7-8ee2-39053c2508b0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:31.425694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9872293a-62ce-4dc7-8ee2-39053c2508b0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1362 microversion: 2.1 time: 0.216648 Dec 16 14:47:31.426255 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 433/887] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:31 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:31.995382 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-332ce9dd-8d8a-4ba3-b7f5-d4ce24c35f3f tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:31.995916 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-332ce9dd-8d8a-4ba3-b7f5-d4ce24c35f3f tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:32.003296 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-332ce9dd-8d8a-4ba3-b7f5-d4ce24c35f3f tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.003734 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-332ce9dd-8d8a-4ba3-b7f5-d4ce24c35f3f tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.004489 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-332ce9dd-8d8a-4ba3-b7f5-d4ce24c35f3f tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.004950 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-332ce9dd-8d8a-4ba3-b7f5-d4ce24c35f3f tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.206558 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-332ce9dd-8d8a-4ba3-b7f5-d4ce24c35f3f tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:32.214861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-332ce9dd-8d8a-4ba3-b7f5-d4ce24c35f3f tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.223248 Dec 16 14:47:32.215483 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 455/888] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:31 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:32.442079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-995bc528-c0a1-471a-8255-d4baa3a99b5a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:32.442685 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-995bc528-c0a1-471a-8255-d4baa3a99b5a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:32.449986 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-995bc528-c0a1-471a-8255-d4baa3a99b5a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.450434 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-995bc528-c0a1-471a-8255-d4baa3a99b5a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.451199 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-995bc528-c0a1-471a-8255-d4baa3a99b5a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.451626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-995bc528-c0a1-471a-8255-d4baa3a99b5a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.647974 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-995bc528-c0a1-471a-8255-d4baa3a99b5a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:32.656097 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-995bc528-c0a1-471a-8255-d4baa3a99b5a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1548 microversion: 2.1 time: 0.218229 Dec 16 14:47:32.656665 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 434/889] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:32 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:32.672233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-685a9948-aaad-48a5-9d0f-c2ec8f3ef5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:32.672707 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-685a9948-aaad-48a5-9d0f-c2ec8f3ef5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:32.679910 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-685a9948-aaad-48a5-9d0f-c2ec8f3ef5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.680346 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-685a9948-aaad-48a5-9d0f-c2ec8f3ef5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.681135 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-685a9948-aaad-48a5-9d0f-c2ec8f3ef5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:32.681561 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-685a9948-aaad-48a5-9d0f-c2ec8f3ef5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:32.823982 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-685a9948-aaad-48a5-9d0f-c2ec8f3ef5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155412 Dec 16 14:47:32.824633 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 456/890] 10.222.0.64 () {58 vars in 1274 bytes} [Thu Dec 16 14:47:32 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:33.232308 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-737cf47d-93e5-4bbb-bf3d-fd282b1d5589 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:33.232938 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-737cf47d-93e5-4bbb-bf3d-fd282b1d5589 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:33.240738 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-737cf47d-93e5-4bbb-bf3d-fd282b1d5589 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:33.241220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-737cf47d-93e5-4bbb-bf3d-fd282b1d5589 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:33.241988 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-737cf47d-93e5-4bbb-bf3d-fd282b1d5589 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:33.242419 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-737cf47d-93e5-4bbb-bf3d-fd282b1d5589 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:33.571757 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-737cf47d-93e5-4bbb-bf3d-fd282b1d5589 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:33.581421 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-737cf47d-93e5-4bbb-bf3d-fd282b1d5589 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.352775 Dec 16 14:47:33.582404 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 435/891] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:33 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:34.510989 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4528ed29-193f-4207-8152-2dec1481857d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:34.512086 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4528ed29-193f-4207-8152-2dec1481857d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:34.512860 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-90871089-0580-457b-a94e-b37c6ccb02c9 req-5dafd735-7d66-42b0-931a-1d4410605c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21eb2e8-5685-4000-b8c6-edb7fb5daa68", "tag": "71ec40cc-e92b-4e94-8b04-7b26de75bfbb"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:34.514493 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:47:34.514493 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:47:34.519829 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4528ed29-193f-4207-8152-2dec1481857d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:34.520146 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4528ed29-193f-4207-8152-2dec1481857d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:34.520939 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4528ed29-193f-4207-8152-2dec1481857d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:34.521448 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4528ed29-193f-4207-8152-2dec1481857d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:34.523184 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-90871089-0580-457b-a94e-b37c6ccb02c9 req-5dafd735-7d66-42b0-931a-1d4410605c41 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:34.523634 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-90871089-0580-457b-a94e-b37c6ccb02c9 req-5dafd735-7d66-42b0-931a-1d4410605c41 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:34.540393 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-90871089-0580-457b-a94e-b37c6ccb02c9 req-5dafd735-7d66-42b0-931a-1d4410605c41 service nova] Creating event network-changed:71ec40cc-e92b-4e94-8b04-7b26de75bfbb for instance e21eb2e8-5685-4000-b8c6-edb7fb5daa68 on hv-cinder-82189 Dec 16 14:47:34.545669 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-90871089-0580-457b-a94e-b37c6ccb02c9 req-5dafd735-7d66-42b0-931a-1d4410605c41 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035993 Dec 16 14:47:34.546438 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 436/892] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:47:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:34.599173 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e2575213-7550-4697-94e6-6df1800303b2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:34.600185 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e2575213-7550-4697-94e6-6df1800303b2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:34.607895 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e2575213-7550-4697-94e6-6df1800303b2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:34.608339 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e2575213-7550-4697-94e6-6df1800303b2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:34.609150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e2575213-7550-4697-94e6-6df1800303b2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:34.609584 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e2575213-7550-4697-94e6-6df1800303b2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:34.643374 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4528ed29-193f-4207-8152-2dec1481857d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 14 microversion: 2.1 time: 0.136087 Dec 16 14:47:34.646740 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 457/893] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:34 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:34.812988 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e2575213-7550-4697-94e6-6df1800303b2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:34.823160 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e2575213-7550-4697-94e6-6df1800303b2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.228055 Dec 16 14:47:34.824037 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 437/894] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:34 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:35.655454 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-da34cb5f-2efc-472b-8667-5127f22f00b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:35.656744 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-da34cb5f-2efc-472b-8667-5127f22f00b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:35.666277 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da34cb5f-2efc-472b-8667-5127f22f00b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:35.666716 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da34cb5f-2efc-472b-8667-5127f22f00b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:35.667486 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da34cb5f-2efc-472b-8667-5127f22f00b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:35.667919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-da34cb5f-2efc-472b-8667-5127f22f00b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:35.786485 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-da34cb5f-2efc-472b-8667-5127f22f00b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 14 microversion: 2.1 time: 0.135422 Dec 16 14:47:35.789611 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 458/895] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:35 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:35.839471 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fc228527-a092-451f-87bf-305040111b58 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:35.840097 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fc228527-a092-451f-87bf-305040111b58 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:35.849141 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fc228527-a092-451f-87bf-305040111b58 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:35.849686 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fc228527-a092-451f-87bf-305040111b58 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:35.850570 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fc228527-a092-451f-87bf-305040111b58 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:35.851098 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fc228527-a092-451f-87bf-305040111b58 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:36.055017 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fc228527-a092-451f-87bf-305040111b58 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:36.063674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fc228527-a092-451f-87bf-305040111b58 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.227941 Dec 16 14:47:36.064486 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 438/896] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:35 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:36.797442 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9d300632-515b-474c-b525-8d973e6dcd9d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:36.798382 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9d300632-515b-474c-b525-8d973e6dcd9d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:36.807259 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d300632-515b-474c-b525-8d973e6dcd9d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:36.807709 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d300632-515b-474c-b525-8d973e6dcd9d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:36.808533 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d300632-515b-474c-b525-8d973e6dcd9d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:36.809048 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d300632-515b-474c-b525-8d973e6dcd9d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:36.941418 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9d300632-515b-474c-b525-8d973e6dcd9d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 14 microversion: 2.1 time: 0.148031 Dec 16 14:47:36.944446 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 459/897] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:36 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:37.081011 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-071539c8-6135-4c8b-9726-eb49173696cd tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:37.081648 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-071539c8-6135-4c8b-9726-eb49173696cd tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:37.088928 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-071539c8-6135-4c8b-9726-eb49173696cd tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.089391 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-071539c8-6135-4c8b-9726-eb49173696cd tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.090155 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-071539c8-6135-4c8b-9726-eb49173696cd tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.090623 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-071539c8-6135-4c8b-9726-eb49173696cd tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.289529 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-071539c8-6135-4c8b-9726-eb49173696cd tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:37.298452 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-071539c8-6135-4c8b-9726-eb49173696cd tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1569 microversion: 2.1 time: 0.221645 Dec 16 14:47:37.299752 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 439/898] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:37 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:47:37.316747 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0d1bbd8b-1092-4ad1-8fe8-0f298774dbe9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:37.317448 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0d1bbd8b-1092-4ad1-8fe8-0f298774dbe9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:37.325346 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d1bbd8b-1092-4ad1-8fe8-0f298774dbe9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.325793 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d1bbd8b-1092-4ad1-8fe8-0f298774dbe9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.326556 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d1bbd8b-1092-4ad1-8fe8-0f298774dbe9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.326984 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0d1bbd8b-1092-4ad1-8fe8-0f298774dbe9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.468526 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0d1bbd8b-1092-4ad1-8fe8-0f298774dbe9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "POST /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459/action" status: 202 len: 0 microversion: 2.1 time: 0.155955 Dec 16 14:47:37.469155 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 460/899] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:37 2021] POST /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:47:37.477615 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8f980e43-4dac-4aaa-bfc3-5d24cf0a54c9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:37.478229 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8f980e43-4dac-4aaa-bfc3-5d24cf0a54c9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:37.485329 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8f980e43-4dac-4aaa-bfc3-5d24cf0a54c9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.485798 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8f980e43-4dac-4aaa-bfc3-5d24cf0a54c9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.486535 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8f980e43-4dac-4aaa-bfc3-5d24cf0a54c9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.486965 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8f980e43-4dac-4aaa-bfc3-5d24cf0a54c9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.697881 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8f980e43-4dac-4aaa-bfc3-5d24cf0a54c9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:37.707215 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8f980e43-4dac-4aaa-bfc3-5d24cf0a54c9 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1517 microversion: 2.1 time: 0.233158 Dec 16 14:47:37.708086 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 440/900] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:37 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:47:37.951901 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e50c428c-0ed1-43bf-aeb9-469388443af9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:37.952825 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e50c428c-0ed1-43bf-aeb9-469388443af9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:37.960657 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e50c428c-0ed1-43bf-aeb9-469388443af9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.961134 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e50c428c-0ed1-43bf-aeb9-469388443af9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:37.961892 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e50c428c-0ed1-43bf-aeb9-469388443af9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:37.962316 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e50c428c-0ed1-43bf-aeb9-469388443af9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:38.079182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e50c428c-0ed1-43bf-aeb9-469388443af9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 14 microversion: 2.1 time: 0.130798 Dec 16 14:47:38.080582 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 461/901] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:37 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:38.724120 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-13bf9f5b-8ecb-4630-baa7-7aacd11df9be tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:38.724706 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-13bf9f5b-8ecb-4630-baa7-7aacd11df9be tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:38.731816 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13bf9f5b-8ecb-4630-baa7-7aacd11df9be tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:38.732329 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13bf9f5b-8ecb-4630-baa7-7aacd11df9be tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:38.733118 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13bf9f5b-8ecb-4630-baa7-7aacd11df9be tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:38.733553 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13bf9f5b-8ecb-4630-baa7-7aacd11df9be tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:38.932953 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-13bf9f5b-8ecb-4630-baa7-7aacd11df9be tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:38.941167 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-13bf9f5b-8ecb-4630-baa7-7aacd11df9be tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1519 microversion: 2.1 time: 0.221348 Dec 16 14:47:38.941737 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 441/902] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:38 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:47:39.092103 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-571255bd-f25c-4616-a23b-4da573b852a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:39.093157 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-571255bd-f25c-4616-a23b-4da573b852a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:39.102042 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-571255bd-f25c-4616-a23b-4da573b852a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:39.102515 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-571255bd-f25c-4616-a23b-4da573b852a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:39.103253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-571255bd-f25c-4616-a23b-4da573b852a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:39.103677 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-571255bd-f25c-4616-a23b-4da573b852a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:39.220198 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-571255bd-f25c-4616-a23b-4da573b852a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 14 microversion: 2.1 time: 0.132561 Dec 16 14:47:39.221012 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 462/903] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:39 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:39.958635 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-00dcfe8a-89e9-422b-b63d-ffd228261fa8 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:39.959260 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-00dcfe8a-89e9-422b-b63d-ffd228261fa8 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:39.966744 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-00dcfe8a-89e9-422b-b63d-ffd228261fa8 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:39.967264 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-00dcfe8a-89e9-422b-b63d-ffd228261fa8 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:39.968089 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-00dcfe8a-89e9-422b-b63d-ffd228261fa8 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:39.968606 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-00dcfe8a-89e9-422b-b63d-ffd228261fa8 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:40.171215 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-00dcfe8a-89e9-422b-b63d-ffd228261fa8 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:40.180369 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-00dcfe8a-89e9-422b-b63d-ffd228261fa8 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1575 microversion: 2.1 time: 0.225525 Dec 16 14:47:40.180972 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 442/904] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:39 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:40.232166 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4aab70b6-b547-4f72-b4bb-bec9e090f366 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:40.233085 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4aab70b6-b547-4f72-b4bb-bec9e090f366 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:40.241657 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4aab70b6-b547-4f72-b4bb-bec9e090f366 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:40.242111 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4aab70b6-b547-4f72-b4bb-bec9e090f366 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:40.242893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4aab70b6-b547-4f72-b4bb-bec9e090f366 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:40.243328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4aab70b6-b547-4f72-b4bb-bec9e090f366 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:40.353994 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4aab70b6-b547-4f72-b4bb-bec9e090f366 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 14 microversion: 2.1 time: 0.126013 Dec 16 14:47:40.354598 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 463/905] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:40 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:40.627330 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-4c4ed02f-5e87-4bff-9a89-f8a516067617 req-ab46fde1-d8cc-477b-a78a-6328687504a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10a0f8d-4ce2-4f76-bdee-a88622ecf459", "name": "network-vif-unplugged", "status": "completed", "tag": "1332f1d9-cf0e-479c-a21e-c9c4facfafe9"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:40.628900 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:47:40.628900 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:47:40.637381 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-4c4ed02f-5e87-4bff-9a89-f8a516067617 req-ab46fde1-d8cc-477b-a78a-6328687504a0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:40.637821 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-4c4ed02f-5e87-4bff-9a89-f8a516067617 req-ab46fde1-d8cc-477b-a78a-6328687504a0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:40.654113 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-4c4ed02f-5e87-4bff-9a89-f8a516067617 req-ab46fde1-d8cc-477b-a78a-6328687504a0 service nova] Creating event network-vif-unplugged:1332f1d9-cf0e-479c-a21e-c9c4facfafe9 for instance e10a0f8d-4ce2-4f76-bdee-a88622ecf459 on hv-cinder-82189 Dec 16 14:47:40.659384 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-4c4ed02f-5e87-4bff-9a89-f8a516067617 req-ab46fde1-d8cc-477b-a78a-6328687504a0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035254 Dec 16 14:47:40.659966 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 443/906] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:47:40 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:41.198423 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-282404b8-015a-4a41-93ba-a2f43e497bab tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:41.199120 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-282404b8-015a-4a41-93ba-a2f43e497bab tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:41.206892 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-282404b8-015a-4a41-93ba-a2f43e497bab tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:41.207328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-282404b8-015a-4a41-93ba-a2f43e497bab tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:41.208080 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-282404b8-015a-4a41-93ba-a2f43e497bab tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:41.208504 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-282404b8-015a-4a41-93ba-a2f43e497bab tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:41.365927 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4cc43910-de6c-4b65-89c5-cf16326f0b37 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:41.366930 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4cc43910-de6c-4b65-89c5-cf16326f0b37 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:41.374470 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4cc43910-de6c-4b65-89c5-cf16326f0b37 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:41.374917 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4cc43910-de6c-4b65-89c5-cf16326f0b37 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:41.375679 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4cc43910-de6c-4b65-89c5-cf16326f0b37 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:41.376114 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4cc43910-de6c-4b65-89c5-cf16326f0b37 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:41.401680 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-282404b8-015a-4a41-93ba-a2f43e497bab tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:41.410396 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-282404b8-015a-4a41-93ba-a2f43e497bab tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1575 microversion: 2.1 time: 0.216185 Dec 16 14:47:41.411256 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 464/907] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:41 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:41.489472 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4cc43910-de6c-4b65-89c5-cf16326f0b37 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 14 microversion: 2.1 time: 0.127956 Dec 16 14:47:41.489986 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 444/908] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:41 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:47:42.427319 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-21bf3de6-4f53-4d48-bd77-205baac76efe tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:42.427905 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-21bf3de6-4f53-4d48-bd77-205baac76efe tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:42.435576 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-21bf3de6-4f53-4d48-bd77-205baac76efe tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:42.436021 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-21bf3de6-4f53-4d48-bd77-205baac76efe tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:42.436813 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-21bf3de6-4f53-4d48-bd77-205baac76efe tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:42.437239 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-21bf3de6-4f53-4d48-bd77-205baac76efe tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:42.500098 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-93900670-983d-4d63-8dab-e6a012827dee tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:42.501204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-93900670-983d-4d63-8dab-e6a012827dee tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:42.509576 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93900670-983d-4d63-8dab-e6a012827dee tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:42.510027 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93900670-983d-4d63-8dab-e6a012827dee tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:42.510795 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93900670-983d-4d63-8dab-e6a012827dee tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:42.511231 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93900670-983d-4d63-8dab-e6a012827dee tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:42.630614 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-93900670-983d-4d63-8dab-e6a012827dee tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 14 microversion: 2.1 time: 0.134409 Dec 16 14:47:42.633653 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 445/909] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:42 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:47:42.636586 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-21bf3de6-4f53-4d48-bd77-205baac76efe tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:42.644755 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-21bf3de6-4f53-4d48-bd77-205baac76efe tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1575 microversion: 2.1 time: 0.221096 Dec 16 14:47:42.645407 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 465/910] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:42 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:42.697103 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:47:42.697312 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: Thu Dec 16 14:47:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 14:47:43.641518 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2a1f0ba5-923b-47e3-9f27-6d83b7419f84 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:43.642542 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2a1f0ba5-923b-47e3-9f27-6d83b7419f84 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:43.651482 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2a1f0ba5-923b-47e3-9f27-6d83b7419f84 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:43.651928 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2a1f0ba5-923b-47e3-9f27-6d83b7419f84 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:43.652694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2a1f0ba5-923b-47e3-9f27-6d83b7419f84 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:43.653155 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2a1f0ba5-923b-47e3-9f27-6d83b7419f84 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:43.662324 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fb8ec33c-1f44-48e0-8175-7f0bb37060d2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:43.663077 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fb8ec33c-1f44-48e0-8175-7f0bb37060d2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:43.670674 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb8ec33c-1f44-48e0-8175-7f0bb37060d2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:43.671119 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb8ec33c-1f44-48e0-8175-7f0bb37060d2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:43.671882 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb8ec33c-1f44-48e0-8175-7f0bb37060d2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:43.672317 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fb8ec33c-1f44-48e0-8175-7f0bb37060d2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:43.774763 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2a1f0ba5-923b-47e3-9f27-6d83b7419f84 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 14 microversion: 2.1 time: 0.137207 Dec 16 14:47:43.775571 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 446/911] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:43 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:43.869095 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fb8ec33c-1f44-48e0-8175-7f0bb37060d2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:43.877977 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fb8ec33c-1f44-48e0-8175-7f0bb37060d2 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1575 microversion: 2.1 time: 0.219632 Dec 16 14:47:43.878534 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 466/912] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:43 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:47:44.787307 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4f085020-0194-4a84-8905-3a739c71e249 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:44.788289 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4f085020-0194-4a84-8905-3a739c71e249 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:44.796135 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f085020-0194-4a84-8905-3a739c71e249 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:44.796580 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f085020-0194-4a84-8905-3a739c71e249 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:44.797389 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f085020-0194-4a84-8905-3a739c71e249 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:44.797819 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4f085020-0194-4a84-8905-3a739c71e249 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:44.895684 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-49b18f64-592b-47ee-b8fe-34b5f10eaa39 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:44.896294 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-49b18f64-592b-47ee-b8fe-34b5f10eaa39 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:44.903940 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-49b18f64-592b-47ee-b8fe-34b5f10eaa39 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:44.904387 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-49b18f64-592b-47ee-b8fe-34b5f10eaa39 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:44.905186 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-49b18f64-592b-47ee-b8fe-34b5f10eaa39 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:44.905622 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-49b18f64-592b-47ee-b8fe-34b5f10eaa39 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:44.925207 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4f085020-0194-4a84-8905-3a739c71e249 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 11817 microversion: 2.1 time: 0.142591 Dec 16 14:47:44.925852 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 447/913] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:44 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 11817 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:45.191020 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-49b18f64-592b-47ee-b8fe-34b5f10eaa39 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:45.199131 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-49b18f64-592b-47ee-b8fe-34b5f10eaa39 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1575 microversion: 2.1 time: 0.307627 Dec 16 14:47:45.199685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 467/914] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:44 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1575 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:47:45.937221 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-666eca19-4c7a-440c-8fc1-d8a3eb5cf0e0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:45.938219 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-666eca19-4c7a-440c-8fc1-d8a3eb5cf0e0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:45.946659 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-666eca19-4c7a-440c-8fc1-d8a3eb5cf0e0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:45.947106 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-666eca19-4c7a-440c-8fc1-d8a3eb5cf0e0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:45.947870 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-666eca19-4c7a-440c-8fc1-d8a3eb5cf0e0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:45.948303 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-666eca19-4c7a-440c-8fc1-d8a3eb5cf0e0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:46.090205 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-666eca19-4c7a-440c-8fc1-d8a3eb5cf0e0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 18398 microversion: 2.1 time: 0.156965 Dec 16 14:47:46.090847 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 448/915] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:45 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 18398 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:46.216301 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-53454e45-219a-46d1-9763-31109821c496 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:46.216993 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-53454e45-219a-46d1-9763-31109821c496 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:46.224117 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-53454e45-219a-46d1-9763-31109821c496 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:46.224615 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-53454e45-219a-46d1-9763-31109821c496 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:46.225599 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-53454e45-219a-46d1-9763-31109821c496 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:46.226053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-53454e45-219a-46d1-9763-31109821c496 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:46.432178 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-53454e45-219a-46d1-9763-31109821c496 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:46.442635 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-53454e45-219a-46d1-9763-31109821c496 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1575 microversion: 2.1 time: 0.230088 Dec 16 14:47:46.443195 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 468/916] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:46 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:47.102680 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2b9a1476-2c40-4b37-bd00-57a1fdf540d9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:47.103681 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2b9a1476-2c40-4b37-bd00-57a1fdf540d9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:47.111540 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b9a1476-2c40-4b37-bd00-57a1fdf540d9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:47.111993 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b9a1476-2c40-4b37-bd00-57a1fdf540d9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:47.112763 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b9a1476-2c40-4b37-bd00-57a1fdf540d9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:47.113223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b9a1476-2c40-4b37-bd00-57a1fdf540d9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:47.247968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2b9a1476-2c40-4b37-bd00-57a1fdf540d9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 19342 microversion: 2.1 time: 0.149318 Dec 16 14:47:47.248874 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 449/917] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:47 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 19342 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:47.459794 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f367815f-f549-4f8f-a0e9-a3407b48f633 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:47.460399 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f367815f-f549-4f8f-a0e9-a3407b48f633 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:47.468083 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f367815f-f549-4f8f-a0e9-a3407b48f633 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:47.468527 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f367815f-f549-4f8f-a0e9-a3407b48f633 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:47.469323 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f367815f-f549-4f8f-a0e9-a3407b48f633 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:47.469748 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f367815f-f549-4f8f-a0e9-a3407b48f633 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:47.677181 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f367815f-f549-4f8f-a0e9-a3407b48f633 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:47.685857 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f367815f-f549-4f8f-a0e9-a3407b48f633 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1575 microversion: 2.1 time: 0.230340 Dec 16 14:47:47.686652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 469/918] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:47 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:48.260541 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-770d799e-8e5c-4020-a65b-332fa291d5c7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:48.261594 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-770d799e-8e5c-4020-a65b-332fa291d5c7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:48.270124 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-770d799e-8e5c-4020-a65b-332fa291d5c7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:48.270573 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-770d799e-8e5c-4020-a65b-332fa291d5c7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:48.271337 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-770d799e-8e5c-4020-a65b-332fa291d5c7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:48.271765 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-770d799e-8e5c-4020-a65b-332fa291d5c7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:48.400187 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-770d799e-8e5c-4020-a65b-332fa291d5c7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 21935 microversion: 2.1 time: 0.143572 Dec 16 14:47:48.401112 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 450/919] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:48 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 21935 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:47:48.703724 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2b8c8e16-cb80-47f1-a81b-4035e7219f65 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:47:48.704338 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2b8c8e16-cb80-47f1-a81b-4035e7219f65 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:48.711663 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b8c8e16-cb80-47f1-a81b-4035e7219f65 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:48.712108 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b8c8e16-cb80-47f1-a81b-4035e7219f65 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:48.712923 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b8c8e16-cb80-47f1-a81b-4035e7219f65 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:48.713364 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b8c8e16-cb80-47f1-a81b-4035e7219f65 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:48.907910 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2b8c8e16-cb80-47f1-a81b-4035e7219f65 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:47:48.916919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2b8c8e16-cb80-47f1-a81b-4035e7219f65 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1562 microversion: 2.1 time: 0.216853 Dec 16 14:47:48.917475 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 470/920] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:47:48 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1562 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:49.412544 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5d8ddb1f-de03-4869-8c74-45aad8c1916b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:49.413564 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5d8ddb1f-de03-4869-8c74-45aad8c1916b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:49.421351 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d8ddb1f-de03-4869-8c74-45aad8c1916b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:49.421798 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d8ddb1f-de03-4869-8c74-45aad8c1916b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:49.422557 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d8ddb1f-de03-4869-8c74-45aad8c1916b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:49.422988 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5d8ddb1f-de03-4869-8c74-45aad8c1916b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:49.546734 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5d8ddb1f-de03-4869-8c74-45aad8c1916b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 23234 microversion: 2.1 time: 0.138381 Dec 16 14:47:49.547712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 451/921] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:49 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 23234 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:50.558694 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-dbb001ea-7e93-4d6e-ac37-326b41d75810 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:50.559648 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-dbb001ea-7e93-4d6e-ac37-326b41d75810 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:50.567406 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dbb001ea-7e93-4d6e-ac37-326b41d75810 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:50.567851 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dbb001ea-7e93-4d6e-ac37-326b41d75810 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:50.568642 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dbb001ea-7e93-4d6e-ac37-326b41d75810 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:50.569091 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dbb001ea-7e93-4d6e-ac37-326b41d75810 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:50.689744 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-dbb001ea-7e93-4d6e-ac37-326b41d75810 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 24771 microversion: 2.1 time: 0.134802 Dec 16 14:47:50.693524 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 471/922] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:50 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 24771 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:50.745319 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-9a5306f2-1f0f-46c9-adc0-5a6dfad86857 req-b698294e-0d2d-4497-b50f-fba95c09a568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10a0f8d-4ce2-4f76-bdee-a88622ecf459", "name": "network-vif-plugged", "status": "completed", "tag": "1332f1d9-cf0e-479c-a21e-c9c4facfafe9"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:50.747044 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:47:50.747044 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:47:50.756189 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-9a5306f2-1f0f-46c9-adc0-5a6dfad86857 req-b698294e-0d2d-4497-b50f-fba95c09a568 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:50.756626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-9a5306f2-1f0f-46c9-adc0-5a6dfad86857 req-b698294e-0d2d-4497-b50f-fba95c09a568 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:50.772141 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-9a5306f2-1f0f-46c9-adc0-5a6dfad86857 req-b698294e-0d2d-4497-b50f-fba95c09a568 service nova] Creating event network-vif-plugged:1332f1d9-cf0e-479c-a21e-c9c4facfafe9 for instance e10a0f8d-4ce2-4f76-bdee-a88622ecf459 on hv-cinder-82189 Dec 16 14:47:50.776712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-9a5306f2-1f0f-46c9-adc0-5a6dfad86857 req-b698294e-0d2d-4497-b50f-fba95c09a568 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035852 Dec 16 14:47:50.777430 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 452/923] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:47:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:51.701720 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b5231603-9027-4d4a-89f5-d9e248023575 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:51.702747 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b5231603-9027-4d4a-89f5-d9e248023575 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:51.711104 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b5231603-9027-4d4a-89f5-d9e248023575 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:51.711551 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b5231603-9027-4d4a-89f5-d9e248023575 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:51.712469 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b5231603-9027-4d4a-89f5-d9e248023575 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:51.712747 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b5231603-9027-4d4a-89f5-d9e248023575 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:51.840640 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b5231603-9027-4d4a-89f5-d9e248023575 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 26520 microversion: 2.1 time: 0.142849 Dec 16 14:47:51.844444 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 472/924] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:51 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 26520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:52.853826 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6da43e44-bb15-460f-96d9-784fd4edcefc tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:52.854791 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6da43e44-bb15-460f-96d9-784fd4edcefc tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:52.862400 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6da43e44-bb15-460f-96d9-784fd4edcefc tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:52.863521 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6da43e44-bb15-460f-96d9-784fd4edcefc tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:52.864283 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6da43e44-bb15-460f-96d9-784fd4edcefc tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:52.864727 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6da43e44-bb15-460f-96d9-784fd4edcefc tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:52.990174 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6da43e44-bb15-460f-96d9-784fd4edcefc tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 27525 microversion: 2.1 time: 0.140835 Dec 16 14:47:52.990786 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 453/925] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:52 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 27525 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:54.002826 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0492ad36-a7ff-4817-932a-8cdd3ed5bd10 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:54.004401 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0492ad36-a7ff-4817-932a-8cdd3ed5bd10 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:54.012438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0492ad36-a7ff-4817-932a-8cdd3ed5bd10 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:54.012947 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0492ad36-a7ff-4817-932a-8cdd3ed5bd10 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:54.013704 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0492ad36-a7ff-4817-932a-8cdd3ed5bd10 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:54.014410 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0492ad36-a7ff-4817-932a-8cdd3ed5bd10 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:54.141364 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0492ad36-a7ff-4817-932a-8cdd3ed5bd10 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 28015 microversion: 2.1 time: 0.142905 Dec 16 14:47:54.141992 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 473/926] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:53 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 28015 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:55.154126 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-728c0cbd-e78f-4de6-ba69-27446653b074 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:55.155038 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-728c0cbd-e78f-4de6-ba69-27446653b074 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:55.163782 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-728c0cbd-e78f-4de6-ba69-27446653b074 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:55.164293 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-728c0cbd-e78f-4de6-ba69-27446653b074 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:55.165033 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-728c0cbd-e78f-4de6-ba69-27446653b074 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:55.165463 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-728c0cbd-e78f-4de6-ba69-27446653b074 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:55.293099 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-728c0cbd-e78f-4de6-ba69-27446653b074 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 28251 microversion: 2.1 time: 0.143149 Dec 16 14:47:55.293796 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 454/927] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:55 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 28251 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:56.305941 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c9c2141d-2b82-4d24-aa15-afdce087885c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:56.306931 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c9c2141d-2b82-4d24-aa15-afdce087885c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:56.314922 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c9c2141d-2b82-4d24-aa15-afdce087885c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:56.315365 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c9c2141d-2b82-4d24-aa15-afdce087885c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:56.316136 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c9c2141d-2b82-4d24-aa15-afdce087885c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:56.317217 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c9c2141d-2b82-4d24-aa15-afdce087885c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:56.442879 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c9c2141d-2b82-4d24-aa15-afdce087885c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 28542 microversion: 2.1 time: 0.140907 Dec 16 14:47:56.443535 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 474/928] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:56 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 28542 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:57.455356 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-48e5e019-d8dd-498a-8345-b94126fa1f9c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:57.456386 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-48e5e019-d8dd-498a-8345-b94126fa1f9c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:57.464931 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-48e5e019-d8dd-498a-8345-b94126fa1f9c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:57.465383 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-48e5e019-d8dd-498a-8345-b94126fa1f9c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:57.466146 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-48e5e019-d8dd-498a-8345-b94126fa1f9c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:57.466584 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-48e5e019-d8dd-498a-8345-b94126fa1f9c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:57.591770 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-48e5e019-d8dd-498a-8345-b94126fa1f9c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 28710 microversion: 2.1 time: 0.140410 Dec 16 14:47:57.592442 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 455/929] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:57 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 28710 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:58.604870 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-cfa70bf7-e07e-4f2c-9eb4-babfc7a76458 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:58.605897 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-cfa70bf7-e07e-4f2c-9eb4-babfc7a76458 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:58.613925 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cfa70bf7-e07e-4f2c-9eb4-babfc7a76458 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:58.614369 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cfa70bf7-e07e-4f2c-9eb4-babfc7a76458 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:58.615148 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cfa70bf7-e07e-4f2c-9eb4-babfc7a76458 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:58.615574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cfa70bf7-e07e-4f2c-9eb4-babfc7a76458 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:58.755372 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-cfa70bf7-e07e-4f2c-9eb4-babfc7a76458 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 28710 microversion: 2.1 time: 0.154620 Dec 16 14:47:58.756076 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 475/930] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:58 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 28710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:47:59.767134 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-457df60b-f86a-4bdd-9aff-09e757b1c09c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:47:59.768125 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-457df60b-f86a-4bdd-9aff-09e757b1c09c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:47:59.776135 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-457df60b-f86a-4bdd-9aff-09e757b1c09c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:59.776586 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-457df60b-f86a-4bdd-9aff-09e757b1c09c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:59.777385 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-457df60b-f86a-4bdd-9aff-09e757b1c09c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:47:59.777813 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-457df60b-f86a-4bdd-9aff-09e757b1c09c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:47:59.900848 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-457df60b-f86a-4bdd-9aff-09e757b1c09c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 28710 microversion: 2.1 time: 0.137681 Dec 16 14:47:59.901485 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 456/931] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:47:59 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 28710 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:00.914161 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2d6ec106-40e6-4bb7-9d21-44d1d6516f3e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:00.915253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2d6ec106-40e6-4bb7-9d21-44d1d6516f3e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:00.923477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2d6ec106-40e6-4bb7-9d21-44d1d6516f3e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:00.923915 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2d6ec106-40e6-4bb7-9d21-44d1d6516f3e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:00.924769 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2d6ec106-40e6-4bb7-9d21-44d1d6516f3e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:00.925224 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2d6ec106-40e6-4bb7-9d21-44d1d6516f3e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:01.064684 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2d6ec106-40e6-4bb7-9d21-44d1d6516f3e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 28984 microversion: 2.1 time: 0.155403 Dec 16 14:48:01.065636 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 476/932] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:00 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 28984 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:02.077641 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-474e2125-fd48-4071-bbb0-99ad4dfb7884 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:02.078559 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-474e2125-fd48-4071-bbb0-99ad4dfb7884 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:02.087147 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-474e2125-fd48-4071-bbb0-99ad4dfb7884 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:02.087602 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-474e2125-fd48-4071-bbb0-99ad4dfb7884 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:02.088381 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-474e2125-fd48-4071-bbb0-99ad4dfb7884 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:02.088835 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-474e2125-fd48-4071-bbb0-99ad4dfb7884 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:02.227600 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-474e2125-fd48-4071-bbb0-99ad4dfb7884 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 31154 microversion: 2.1 time: 0.154050 Dec 16 14:48:02.228272 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 457/933] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:02 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 31154 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:03.240943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0e57bdc7-5944-4f6b-8fbc-6684dcc90c6e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:03.242520 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0e57bdc7-5944-4f6b-8fbc-6684dcc90c6e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:03.250882 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0e57bdc7-5944-4f6b-8fbc-6684dcc90c6e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:03.251332 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0e57bdc7-5944-4f6b-8fbc-6684dcc90c6e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:03.252110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0e57bdc7-5944-4f6b-8fbc-6684dcc90c6e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:03.252549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0e57bdc7-5944-4f6b-8fbc-6684dcc90c6e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:03.385060 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0e57bdc7-5944-4f6b-8fbc-6684dcc90c6e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 33065 microversion: 2.1 time: 0.148697 Dec 16 14:48:03.385703 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 477/934] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:03 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 33065 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:04.399058 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-104dd4d8-79a3-45be-9462-480116f71c4a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:04.400071 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-104dd4d8-79a3-45be-9462-480116f71c4a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:04.408578 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-104dd4d8-79a3-45be-9462-480116f71c4a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:04.409060 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-104dd4d8-79a3-45be-9462-480116f71c4a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:04.410026 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-104dd4d8-79a3-45be-9462-480116f71c4a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:04.410596 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-104dd4d8-79a3-45be-9462-480116f71c4a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:04.537197 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-104dd4d8-79a3-45be-9462-480116f71c4a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 34165 microversion: 2.1 time: 0.142064 Dec 16 14:48:04.537842 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 458/935] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:04 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 34165 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:48:05.550076 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e7430bcc-3498-48b4-a13c-0aa9a530834e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:05.551077 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e7430bcc-3498-48b4-a13c-0aa9a530834e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:05.559192 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e7430bcc-3498-48b4-a13c-0aa9a530834e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:05.559656 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e7430bcc-3498-48b4-a13c-0aa9a530834e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:05.560439 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e7430bcc-3498-48b4-a13c-0aa9a530834e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:05.560883 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e7430bcc-3498-48b4-a13c-0aa9a530834e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:05.707215 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e7430bcc-3498-48b4-a13c-0aa9a530834e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 35099 microversion: 2.1 time: 0.161274 Dec 16 14:48:05.709127 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 478/936] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:05 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 35099 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:48:06.722342 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-23918eee-cd9f-4964-9ced-1197b9c5356e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:06.723520 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-23918eee-cd9f-4964-9ced-1197b9c5356e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:06.732393 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-23918eee-cd9f-4964-9ced-1197b9c5356e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:06.732881 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-23918eee-cd9f-4964-9ced-1197b9c5356e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:06.733673 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-23918eee-cd9f-4964-9ced-1197b9c5356e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:06.734113 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-23918eee-cd9f-4964-9ced-1197b9c5356e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:06.866686 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-23918eee-cd9f-4964-9ced-1197b9c5356e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 36340 microversion: 2.1 time: 0.149570 Dec 16 14:48:06.867354 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 459/937] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:06 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 36340 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:07.884144 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b5be629d-ea56-4338-8f9d-b357b22af698 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:07.885898 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b5be629d-ea56-4338-8f9d-b357b22af698 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:07.898694 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b5be629d-ea56-4338-8f9d-b357b22af698 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:07.899423 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b5be629d-ea56-4338-8f9d-b357b22af698 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:07.900754 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b5be629d-ea56-4338-8f9d-b357b22af698 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:07.901534 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b5be629d-ea56-4338-8f9d-b357b22af698 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:08.072212 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b5be629d-ea56-4338-8f9d-b357b22af698 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 38000 microversion: 2.1 time: 0.195696 Dec 16 14:48:08.073210 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 479/938] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:07 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 38000 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:09.085606 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-31378969-4542-4a7e-a0d4-13a37a0f05bf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:09.086620 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-31378969-4542-4a7e-a0d4-13a37a0f05bf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:09.094979 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-31378969-4542-4a7e-a0d4-13a37a0f05bf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:09.095414 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-31378969-4542-4a7e-a0d4-13a37a0f05bf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:09.096206 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-31378969-4542-4a7e-a0d4-13a37a0f05bf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:09.096640 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-31378969-4542-4a7e-a0d4-13a37a0f05bf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:09.225275 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-31378969-4542-4a7e-a0d4-13a37a0f05bf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 38240 microversion: 2.1 time: 0.143659 Dec 16 14:48:09.225969 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 460/939] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:09 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 38240 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:10.238255 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3231ba4e-f708-4822-8f31-2a4a8356c45f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:10.239248 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3231ba4e-f708-4822-8f31-2a4a8356c45f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:10.248082 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3231ba4e-f708-4822-8f31-2a4a8356c45f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:10.248538 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3231ba4e-f708-4822-8f31-2a4a8356c45f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:10.249368 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3231ba4e-f708-4822-8f31-2a4a8356c45f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:10.249797 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3231ba4e-f708-4822-8f31-2a4a8356c45f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:10.379107 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3231ba4e-f708-4822-8f31-2a4a8356c45f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 38240 microversion: 2.1 time: 0.144656 Dec 16 14:48:10.386803 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 480/940] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:10 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 38240 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:11.393376 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5161030e-71c1-44cc-9fd3-ec2d51b9dfb6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:11.394402 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5161030e-71c1-44cc-9fd3-ec2d51b9dfb6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:11.402840 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5161030e-71c1-44cc-9fd3-ec2d51b9dfb6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:11.403289 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5161030e-71c1-44cc-9fd3-ec2d51b9dfb6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:11.404075 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5161030e-71c1-44cc-9fd3-ec2d51b9dfb6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:11.404508 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5161030e-71c1-44cc-9fd3-ec2d51b9dfb6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:11.521489 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5161030e-71c1-44cc-9fd3-ec2d51b9dfb6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 38240 microversion: 2.1 time: 0.132345 Dec 16 14:48:11.522147 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 461/941] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:11 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 38240 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:12.533493 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fdb22971-9921-4010-843e-447885942bde tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:12.534477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fdb22971-9921-4010-843e-447885942bde tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:12.542474 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fdb22971-9921-4010-843e-447885942bde tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:12.542915 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fdb22971-9921-4010-843e-447885942bde tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:12.543669 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fdb22971-9921-4010-843e-447885942bde tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:12.544092 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fdb22971-9921-4010-843e-447885942bde tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:12.672886 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fdb22971-9921-4010-843e-447885942bde tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 200 len: 38369 microversion: 2.1 time: 0.143334 Dec 16 14:48:12.673539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 481/942] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:12 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 38369 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:12.684691 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-1bea3686-149b-4088-9df3-28d51386b977 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:12.685328 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-1bea3686-149b-4088-9df3-28d51386b977 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:12.694593 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1bea3686-149b-4088-9df3-28d51386b977 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:12.695032 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1bea3686-149b-4088-9df3-28d51386b977 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:12.695813 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1bea3686-149b-4088-9df3-28d51386b977 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:12.696240 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-1bea3686-149b-4088-9df3-28d51386b977 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:12.766485 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1bea3686-149b-4088-9df3-28d51386b977 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/ips" status: 200 len: 146 microversion: 2.1 time: 0.085797 Dec 16 14:48:12.767540 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 462/943] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Dec 16 14:48:12 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/ips => generated 146 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:15.211705 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-760e22bd-d059-4e6e-85e7-3eb37c8462b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4f2925e-ddb9-482a-b048-ed47a8015df3"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:15.212866 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-760e22bd-d059-4e6e-85e7-3eb37c8462b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:15.220735 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-760e22bd-d059-4e6e-85e7-3eb37c8462b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:15.221224 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-760e22bd-d059-4e6e-85e7-3eb37c8462b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:15.222001 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-760e22bd-d059-4e6e-85e7-3eb37c8462b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:15.222532 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-760e22bd-d059-4e6e-85e7-3eb37c8462b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:15.613262 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-760e22bd-d059-4e6e-85e7-3eb37c8462b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405578 Dec 16 14:48:15.613877 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 482/944] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:48:15 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:23.501908 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6395bd14-274f-4a3b-bc6d-450013872682 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:23.510763 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6395bd14-274f-4a3b-bc6d-450013872682 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:23.511211 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6395bd14-274f-4a3b-bc6d-450013872682 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:23.567736 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6395bd14-274f-4a3b-bc6d-450013872682 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Going to try to stop instance {{(pid=101915) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Dec 16 14:48:23.646968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6395bd14-274f-4a3b-bc6d-450013872682 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 202 len: 0 microversion: 2.1 time: 0.148267 Dec 16 14:48:23.647993 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 463/945] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:23 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:48:23.656596 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b977650c-4349-4ece-a72c-40e5f37460ba tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:23.657330 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b977650c-4349-4ece-a72c-40e5f37460ba tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:23.667327 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b977650c-4349-4ece-a72c-40e5f37460ba tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:23.667782 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b977650c-4349-4ece-a72c-40e5f37460ba tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:23.668582 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b977650c-4349-4ece-a72c-40e5f37460ba tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:23.669062 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b977650c-4349-4ece-a72c-40e5f37460ba tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:23.880280 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b977650c-4349-4ece-a72c-40e5f37460ba tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:23.889768 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b977650c-4349-4ece-a72c-40e5f37460ba tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.237342 Dec 16 14:48:23.890332 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 483/946] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:23 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:24.907194 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-09871aed-cc4c-4d79-9520-e1b457483b4c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:24.907889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-09871aed-cc4c-4d79-9520-e1b457483b4c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:24.916254 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-09871aed-cc4c-4d79-9520-e1b457483b4c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:24.916708 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-09871aed-cc4c-4d79-9520-e1b457483b4c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:24.917505 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-09871aed-cc4c-4d79-9520-e1b457483b4c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:24.917941 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-09871aed-cc4c-4d79-9520-e1b457483b4c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:25.121677 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-09871aed-cc4c-4d79-9520-e1b457483b4c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:25.130620 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-09871aed-cc4c-4d79-9520-e1b457483b4c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.227621 Dec 16 14:48:25.131105 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 464/947] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:24 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:26.148861 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-40954e42-3538-4442-b59d-05c1b481103a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:26.149419 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-40954e42-3538-4442-b59d-05c1b481103a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:26.157204 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-40954e42-3538-4442-b59d-05c1b481103a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:26.157653 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-40954e42-3538-4442-b59d-05c1b481103a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:26.158425 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-40954e42-3538-4442-b59d-05c1b481103a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:26.158857 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-40954e42-3538-4442-b59d-05c1b481103a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:26.362845 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-40954e42-3538-4442-b59d-05c1b481103a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:26.371371 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-40954e42-3538-4442-b59d-05c1b481103a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.226876 Dec 16 14:48:26.371927 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 484/948] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:26 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:27.388043 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-82d1165a-5a23-430e-aa44-c1e358df9893 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:27.388644 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-82d1165a-5a23-430e-aa44-c1e358df9893 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:27.396404 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-82d1165a-5a23-430e-aa44-c1e358df9893 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:27.396885 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-82d1165a-5a23-430e-aa44-c1e358df9893 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:27.397698 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-82d1165a-5a23-430e-aa44-c1e358df9893 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:27.398130 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-82d1165a-5a23-430e-aa44-c1e358df9893 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:27.603031 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-82d1165a-5a23-430e-aa44-c1e358df9893 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:27.612212 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-82d1165a-5a23-430e-aa44-c1e358df9893 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.227746 Dec 16 14:48:27.612823 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 465/949] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:27 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:28.629229 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-88f5d7fe-c887-46f1-af12-4bd89d900d01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:28.629845 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-88f5d7fe-c887-46f1-af12-4bd89d900d01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:28.637913 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-88f5d7fe-c887-46f1-af12-4bd89d900d01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:28.638366 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-88f5d7fe-c887-46f1-af12-4bd89d900d01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:28.639148 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-88f5d7fe-c887-46f1-af12-4bd89d900d01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:28.639576 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-88f5d7fe-c887-46f1-af12-4bd89d900d01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:28.834435 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-88f5d7fe-c887-46f1-af12-4bd89d900d01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:28.843072 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-88f5d7fe-c887-46f1-af12-4bd89d900d01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.217709 Dec 16 14:48:28.843956 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 485/950] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:28 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:29.861898 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-75f74a70-56a5-4989-8ef2-f0c549a862af tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:29.862548 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-75f74a70-56a5-4989-8ef2-f0c549a862af tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:29.870160 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-75f74a70-56a5-4989-8ef2-f0c549a862af tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:29.870618 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-75f74a70-56a5-4989-8ef2-f0c549a862af tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:29.871384 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-75f74a70-56a5-4989-8ef2-f0c549a862af tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:29.871815 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-75f74a70-56a5-4989-8ef2-f0c549a862af tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:30.069334 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-75f74a70-56a5-4989-8ef2-f0c549a862af tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:30.078575 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-75f74a70-56a5-4989-8ef2-f0c549a862af tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.220581 Dec 16 14:48:30.079128 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 466/951] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:29 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:31.095340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b4e385f5-fb05-45b1-9c62-ddbe2b44a319 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:31.095943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b4e385f5-fb05-45b1-9c62-ddbe2b44a319 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:31.103569 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b4e385f5-fb05-45b1-9c62-ddbe2b44a319 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:31.104004 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b4e385f5-fb05-45b1-9c62-ddbe2b44a319 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:31.104755 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b4e385f5-fb05-45b1-9c62-ddbe2b44a319 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:31.105210 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b4e385f5-fb05-45b1-9c62-ddbe2b44a319 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:31.295183 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b4e385f5-fb05-45b1-9c62-ddbe2b44a319 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:31.303691 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b4e385f5-fb05-45b1-9c62-ddbe2b44a319 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.212035 Dec 16 14:48:31.304253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 486/952] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:31 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:32.319728 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-5b495a2a-e301-492d-9ddd-e73535826a98 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:32.320369 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-5b495a2a-e301-492d-9ddd-e73535826a98 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:32.328015 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5b495a2a-e301-492d-9ddd-e73535826a98 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:32.328466 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5b495a2a-e301-492d-9ddd-e73535826a98 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:32.329274 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5b495a2a-e301-492d-9ddd-e73535826a98 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:32.329710 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-5b495a2a-e301-492d-9ddd-e73535826a98 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:32.532666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-5b495a2a-e301-492d-9ddd-e73535826a98 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:32.541994 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-5b495a2a-e301-492d-9ddd-e73535826a98 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.225693 Dec 16 14:48:32.542595 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 467/953] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:32 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:33.558961 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-48acebe4-edc5-4407-b6e0-081c9ccfa1ad tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:33.559591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-48acebe4-edc5-4407-b6e0-081c9ccfa1ad tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:33.566912 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-48acebe4-edc5-4407-b6e0-081c9ccfa1ad tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:33.567358 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-48acebe4-edc5-4407-b6e0-081c9ccfa1ad tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:33.568122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-48acebe4-edc5-4407-b6e0-081c9ccfa1ad tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:33.568545 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-48acebe4-edc5-4407-b6e0-081c9ccfa1ad tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:33.761907 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-48acebe4-edc5-4407-b6e0-081c9ccfa1ad tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:33.770527 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-48acebe4-edc5-4407-b6e0-081c9ccfa1ad tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.215830 Dec 16 14:48:33.771080 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 487/954] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:33 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:34.787964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-01164337-839c-4c20-baa9-6c6642473f6d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:34.788574 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-01164337-839c-4c20-baa9-6c6642473f6d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:34.796376 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-01164337-839c-4c20-baa9-6c6642473f6d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:34.796892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-01164337-839c-4c20-baa9-6c6642473f6d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:34.797608 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-01164337-839c-4c20-baa9-6c6642473f6d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:34.798034 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-01164337-839c-4c20-baa9-6c6642473f6d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:35.001600 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-01164337-839c-4c20-baa9-6c6642473f6d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:35.010939 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-01164337-839c-4c20-baa9-6c6642473f6d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.226627 Dec 16 14:48:35.011507 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 468/955] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:34 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:36.029176 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-072cf014-c757-439e-8ad5-93da36c31d19 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:36.029685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-072cf014-c757-439e-8ad5-93da36c31d19 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:36.037054 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-072cf014-c757-439e-8ad5-93da36c31d19 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:36.037499 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-072cf014-c757-439e-8ad5-93da36c31d19 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:36.038265 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-072cf014-c757-439e-8ad5-93da36c31d19 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:36.038689 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-072cf014-c757-439e-8ad5-93da36c31d19 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:36.232204 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-072cf014-c757-439e-8ad5-93da36c31d19 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:36.241042 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-072cf014-c757-439e-8ad5-93da36c31d19 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.215524 Dec 16 14:48:36.241621 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 488/956] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:36 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:37.257823 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9f2e7419-2a0d-4bcb-9c56-d7f3b5fc8bac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:37.258492 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9f2e7419-2a0d-4bcb-9c56-d7f3b5fc8bac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:37.265849 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9f2e7419-2a0d-4bcb-9c56-d7f3b5fc8bac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:37.266293 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9f2e7419-2a0d-4bcb-9c56-d7f3b5fc8bac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:37.267054 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9f2e7419-2a0d-4bcb-9c56-d7f3b5fc8bac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:37.267479 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9f2e7419-2a0d-4bcb-9c56-d7f3b5fc8bac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:37.459150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-9f2e7419-2a0d-4bcb-9c56-d7f3b5fc8bac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:37.468311 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9f2e7419-2a0d-4bcb-9c56-d7f3b5fc8bac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.214183 Dec 16 14:48:37.468906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 469/957] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:37 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:38.485734 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-66e8463f-a937-4468-9a0a-1dc7019a1943 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:38.486321 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-66e8463f-a937-4468-9a0a-1dc7019a1943 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:38.494124 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-66e8463f-a937-4468-9a0a-1dc7019a1943 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:38.494564 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-66e8463f-a937-4468-9a0a-1dc7019a1943 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:38.495328 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-66e8463f-a937-4468-9a0a-1dc7019a1943 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:38.495756 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-66e8463f-a937-4468-9a0a-1dc7019a1943 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:38.689067 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-66e8463f-a937-4468-9a0a-1dc7019a1943 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:38.697526 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-66e8463f-a937-4468-9a0a-1dc7019a1943 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1723 microversion: 2.1 time: 0.215497 Dec 16 14:48:38.698082 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 489/958] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:38 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:39.714245 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-305a5668-b964-4480-b582-8075bb47ce73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:39.714848 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-305a5668-b964-4480-b582-8075bb47ce73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:39.722131 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-305a5668-b964-4480-b582-8075bb47ce73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:39.722582 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-305a5668-b964-4480-b582-8075bb47ce73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:39.723352 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-305a5668-b964-4480-b582-8075bb47ce73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:39.723786 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-305a5668-b964-4480-b582-8075bb47ce73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:39.916834 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-305a5668-b964-4480-b582-8075bb47ce73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:39.925720 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-305a5668-b964-4480-b582-8075bb47ce73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1700 microversion: 2.1 time: 0.215207 Dec 16 14:48:39.926281 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 470/959] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:39 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1700 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:39.942033 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7e8c25e8-cec0-4229-8b8c-1ecf34882b6b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:48:39.950385 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7e8c25e8-cec0-4229-8b8c-1ecf34882b6b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:39.950825 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7e8c25e8-cec0-4229-8b8c-1ecf34882b6b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:40.007388 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7e8c25e8-cec0-4229-8b8c-1ecf34882b6b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Going to try to start instance {{(pid=101914) start /opt/stack/nova/nova/compute/api.py:2625}} Dec 16 14:48:40.082554 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7e8c25e8-cec0-4229-8b8c-1ecf34882b6b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 202 len: 0 microversion: 2.1 time: 0.143939 Dec 16 14:48:40.083143 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 490/960] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:48:39 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:48:40.090944 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f4ec3be5-78ea-4d53-855b-1b213d38680d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:40.091553 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f4ec3be5-78ea-4d53-855b-1b213d38680d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:40.098679 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f4ec3be5-78ea-4d53-855b-1b213d38680d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:40.099121 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f4ec3be5-78ea-4d53-855b-1b213d38680d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:40.099998 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f4ec3be5-78ea-4d53-855b-1b213d38680d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:40.100436 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f4ec3be5-78ea-4d53-855b-1b213d38680d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:40.390862 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f4ec3be5-78ea-4d53-855b-1b213d38680d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:40.400100 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f4ec3be5-78ea-4d53-855b-1b213d38680d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1709 microversion: 2.1 time: 0.312216 Dec 16 14:48:40.400903 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 471/961] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:40 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1709 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:41.418193 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-02d1d677-75bc-4ff6-b859-fc91ea5dd64a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:41.418781 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-02d1d677-75bc-4ff6-b859-fc91ea5dd64a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:41.426108 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-02d1d677-75bc-4ff6-b859-fc91ea5dd64a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:41.426547 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-02d1d677-75bc-4ff6-b859-fc91ea5dd64a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:41.427371 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-02d1d677-75bc-4ff6-b859-fc91ea5dd64a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:41.427727 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-02d1d677-75bc-4ff6-b859-fc91ea5dd64a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:41.629638 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-02d1d677-75bc-4ff6-b859-fc91ea5dd64a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:41.638361 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-02d1d677-75bc-4ff6-b859-fc91ea5dd64a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1709 microversion: 2.1 time: 0.224623 Dec 16 14:48:41.638923 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 491/962] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:41 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1709 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:42.656727 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-12d21b31-cb58-48f4-bbfd-e80cfb7b4f86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:48:42.657402 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-12d21b31-cb58-48f4-bbfd-e80cfb7b4f86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:48:42.664585 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-12d21b31-cb58-48f4-bbfd-e80cfb7b4f86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:42.665053 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-12d21b31-cb58-48f4-bbfd-e80cfb7b4f86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:42.665809 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-12d21b31-cb58-48f4-bbfd-e80cfb7b4f86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:48:42.666232 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-12d21b31-cb58-48f4-bbfd-e80cfb7b4f86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:48:42.857931 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-12d21b31-cb58-48f4-bbfd-e80cfb7b4f86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:48:42.866661 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-12d21b31-cb58-48f4-bbfd-e80cfb7b4f86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1713 microversion: 2.1 time: 0.213601 Dec 16 14:48:42.867222 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 472/963] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:48:42 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1713 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:06.092028 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-dd858823-ff09-472b-96c0-c3692e3591a6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:06.093523 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-dd858823-ff09-472b-96c0-c3692e3591a6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:06.097125 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-3af451f2-d3dd-4fcd-ba7e-a0c383c56657 req-b6214310-6f8a-4a3c-98d0-736b4ed2cd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10a0f8d-4ce2-4f76-bdee-a88622ecf459", "tag": "1332f1d9-cf0e-479c-a21e-c9c4facfafe9"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:06.098651 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:49:06.098651 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:49:06.103371 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd858823-ff09-472b-96c0-c3692e3591a6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:06.104205 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd858823-ff09-472b-96c0-c3692e3591a6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:06.105218 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd858823-ff09-472b-96c0-c3692e3591a6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:06.105658 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd858823-ff09-472b-96c0-c3692e3591a6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:06.107736 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-3af451f2-d3dd-4fcd-ba7e-a0c383c56657 req-b6214310-6f8a-4a3c-98d0-736b4ed2cd94 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:06.108186 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-3af451f2-d3dd-4fcd-ba7e-a0c383c56657 req-b6214310-6f8a-4a3c-98d0-736b4ed2cd94 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:06.125906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-3af451f2-d3dd-4fcd-ba7e-a0c383c56657 req-b6214310-6f8a-4a3c-98d0-736b4ed2cd94 service nova] Creating event network-changed:1332f1d9-cf0e-479c-a21e-c9c4facfafe9 for instance e10a0f8d-4ce2-4f76-bdee-a88622ecf459 on hv-cinder-82189 Dec 16 14:49:06.131128 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-3af451f2-d3dd-4fcd-ba7e-a0c383c56657 req-b6214310-6f8a-4a3c-98d0-736b4ed2cd94 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039268 Dec 16 14:49:06.133023 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 473/964] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:49:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:49:06.173945 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-dd858823-ff09-472b-96c0-c3692e3591a6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Going to try to terminate instance {{(pid=101914) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:49:06.299231 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-dd858823-ff09-472b-96c0-c3692e3591a6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 204 len: 0 microversion: 2.1 time: 0.210207 Dec 16 14:49:06.300405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 492/965] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:49:06 2021] DELETE /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:49:06.310062 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c61f260a-c079-4642-b471-5e484a256829 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:06.311371 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c61f260a-c079-4642-b471-5e484a256829 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:06.322360 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c61f260a-c079-4642-b471-5e484a256829 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:06.323237 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c61f260a-c079-4642-b471-5e484a256829 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:06.324472 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c61f260a-c079-4642-b471-5e484a256829 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:06.325174 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c61f260a-c079-4642-b471-5e484a256829 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:06.564352 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c61f260a-c079-4642-b471-5e484a256829 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:06.572826 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c61f260a-c079-4642-b471-5e484a256829 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1568 microversion: 2.1 time: 0.267563 Dec 16 14:49:06.573653 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 474/966] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:06 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:07.591435 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a2c14f4d-0c59-4907-8de5-ee5b3a10cee6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:07.592141 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a2c14f4d-0c59-4907-8de5-ee5b3a10cee6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:07.601027 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2c14f4d-0c59-4907-8de5-ee5b3a10cee6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:07.601477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2c14f4d-0c59-4907-8de5-ee5b3a10cee6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:07.602259 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2c14f4d-0c59-4907-8de5-ee5b3a10cee6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:07.602697 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a2c14f4d-0c59-4907-8de5-ee5b3a10cee6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:07.798117 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-a2c14f4d-0c59-4907-8de5-ee5b3a10cee6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:07.806333 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a2c14f4d-0c59-4907-8de5-ee5b3a10cee6 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1449 microversion: 2.1 time: 0.219082 Dec 16 14:49:07.806901 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 493/967] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:07 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1449 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:08.823374 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-83352161-327b-4185-aec8-b3e4313129eb tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:08.824545 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-83352161-327b-4185-aec8-b3e4313129eb tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:08.831780 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83352161-327b-4185-aec8-b3e4313129eb tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:08.832223 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83352161-327b-4185-aec8-b3e4313129eb tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:08.833022 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83352161-327b-4185-aec8-b3e4313129eb tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:08.833459 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-83352161-327b-4185-aec8-b3e4313129eb tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:08.946784 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-83352161-327b-4185-aec8-b3e4313129eb tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:08.955260 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-83352161-327b-4185-aec8-b3e4313129eb tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1382 microversion: 2.1 time: 0.135629 Dec 16 14:49:08.956046 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 475/968] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:08 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1382 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:49:09.053980 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-47d77584-fc62-4ba0-9429-97eea3aafda9 req-ecb8ecc6-c44d-46de-9ad4-7811f818561b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10a0f8d-4ce2-4f76-bdee-a88622ecf459", "name": "network-vif-deleted", "tag": "1332f1d9-cf0e-479c-a21e-c9c4facfafe9"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:09.055763 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:49:09.055763 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:49:09.065312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-47d77584-fc62-4ba0-9429-97eea3aafda9 req-ecb8ecc6-c44d-46de-9ad4-7811f818561b service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:09.065748 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-47d77584-fc62-4ba0-9429-97eea3aafda9 req-ecb8ecc6-c44d-46de-9ad4-7811f818561b service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:09.082225 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-47d77584-fc62-4ba0-9429-97eea3aafda9 req-ecb8ecc6-c44d-46de-9ad4-7811f818561b service nova] Creating event network-vif-deleted:1332f1d9-cf0e-479c-a21e-c9c4facfafe9 for instance e10a0f8d-4ce2-4f76-bdee-a88622ecf459 on hv-cinder-82189 Dec 16 14:49:09.086795 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-47d77584-fc62-4ba0-9429-97eea3aafda9 req-ecb8ecc6-c44d-46de-9ad4-7811f818561b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036597 Dec 16 14:49:09.087497 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 494/969] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:09.971281 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:09.972270 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:09.979175 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:09.979630 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:09.980751 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:09.980894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:10.049389 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:10.050752 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:10.051269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lazy-loading 'fault' on Instance uuid e10a0f8d-4ce2-4f76-bdee-a88622ecf459 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:49:10.110161 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00d30670c444605a25d63560d82fcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46480af5f9db43618ad0897695518251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:10.119448 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-65736806-574f-443a-8b6c-4de1958ed540 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 200 len: 1224 microversion: 2.1 time: 0.151871 Dec 16 14:49:10.120014 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 476/970] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:09 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 1224 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:11.137890 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9fd1fc54-291d-401d-9cd9-fda59d963580 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:11.138487 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9fd1fc54-291d-401d-9cd9-fda59d963580 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] [instance: e10a0f8d-4ce2-4f76-bdee-a88622ecf459] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:11.146584 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9fd1fc54-291d-401d-9cd9-fda59d963580 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:11.147043 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9fd1fc54-291d-401d-9cd9-fda59d963580 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:11.147819 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9fd1fc54-291d-401d-9cd9-fda59d963580 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:11.148253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9fd1fc54-291d-401d-9cd9-fda59d963580 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:11.196588 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-9fd1fc54-291d-401d-9cd9-fda59d963580 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] HTTP exception thrown: Instance e10a0f8d-4ce2-4f76-bdee-a88622ecf459 could not be found. Dec 16 14:49:11.197214 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9fd1fc54-291d-401d-9cd9-fda59d963580 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Returning 404 to user: Instance e10a0f8d-4ce2-4f76-bdee-a88622ecf459 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:49:11.198075 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9fd1fc54-291d-401d-9cd9-fda59d963580 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459" status: 404 len: 111 microversion: 2.1 time: 0.064815 Dec 16 14:49:11.198618 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 495/971] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:11 2021] GET /compute/v2.1/servers/e10a0f8d-4ce2-4f76-bdee-a88622ecf459 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:49:11.402363 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-cdd29ca8-6fe2-41cf-8ff4-f43e75a0c922 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] Calling method '.version_select at 0x7f3c2c367040>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:11.420160 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-cdd29ca8-6fe2-41cf-8ff4-f43e75a0c922 tempest-TestShelveInstance-721658815 tempest-TestShelveInstance-721658815-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-900255515" status: 202 len: 0 microversion: 2.1 time: 0.021194 Dec 16 14:49:11.420753 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 477/972] 10.222.0.64 () {58 vars in 1250 bytes} [Thu Dec 16 14:49:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-900255515 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:49:15.382527 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-292bdb1d-5c66-46f8-b921-65b55e2606a3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:15.383645 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-292bdb1d-5c66-46f8-b921-65b55e2606a3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:15.391208 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-292bdb1d-5c66-46f8-b921-65b55e2606a3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:15.391920 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-292bdb1d-5c66-46f8-b921-65b55e2606a3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:15.393181 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-292bdb1d-5c66-46f8-b921-65b55e2606a3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:15.393893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-292bdb1d-5c66-46f8-b921-65b55e2606a3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:15.576987 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.objects.instance [None req-292bdb1d-5c66-46f8-b921-65b55e2606a3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lazy-loading 'services' on Instance uuid e21eb2e8-5685-4000-b8c6-edb7fb5daa68 {{(pid=101914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:49:15.740626 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-292bdb1d-5c66-46f8-b921-65b55e2606a3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/os-volume_attachments/e4f2925e-ddb9-482a-b048-ed47a8015df3" status: 202 len: 0 microversion: 2.1 time: 0.361983 Dec 16 14:49:15.740626 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 496/973] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:49:15 2021] DELETE /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/os-volume_attachments/e4f2925e-ddb9-482a-b048-ed47a8015df3 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:49:16.990146 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8c08f100-3539-43a5-a05f-f3b0b3bcce13 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:16.997588 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8c08f100-3539-43a5-a05f-f3b0b3bcce13 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:16.998032 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8c08f100-3539-43a5-a05f-f3b0b3bcce13 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:17.060144 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8c08f100-3539-43a5-a05f-f3b0b3bcce13 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Going to try to stop instance {{(pid=101915) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Dec 16 14:49:17.139150 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8c08f100-3539-43a5-a05f-f3b0b3bcce13 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 202 len: 0 microversion: 2.1 time: 0.153087 Dec 16 14:49:17.139896 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 478/974] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:49:16 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:49:17.148259 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-567a9d64-bd73-48f7-a507-d4e4431627c0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:17.149626 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-567a9d64-bd73-48f7-a507-d4e4431627c0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:17.158326 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-567a9d64-bd73-48f7-a507-d4e4431627c0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:17.158872 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-567a9d64-bd73-48f7-a507-d4e4431627c0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:17.159622 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-567a9d64-bd73-48f7-a507-d4e4431627c0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:17.160046 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-567a9d64-bd73-48f7-a507-d4e4431627c0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:17.543689 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-567a9d64-bd73-48f7-a507-d4e4431627c0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:17.552605 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-567a9d64-bd73-48f7-a507-d4e4431627c0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1677 microversion: 2.1 time: 0.408404 Dec 16 14:49:17.553216 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 497/975] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:17 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1677 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:18.570767 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-de01ec24-4469-4a17-a710-5cf62cea9bcf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:18.571454 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-de01ec24-4469-4a17-a710-5cf62cea9bcf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:18.578906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de01ec24-4469-4a17-a710-5cf62cea9bcf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:18.579371 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de01ec24-4469-4a17-a710-5cf62cea9bcf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:18.580114 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de01ec24-4469-4a17-a710-5cf62cea9bcf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:18.580540 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-de01ec24-4469-4a17-a710-5cf62cea9bcf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:18.957429 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-de01ec24-4469-4a17-a710-5cf62cea9bcf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:18.965568 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-de01ec24-4469-4a17-a710-5cf62cea9bcf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1677 microversion: 2.1 time: 0.398950 Dec 16 14:49:18.966129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 479/976] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:18 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1677 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:19.983005 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4a53572f-5877-4afe-a427-e890ed353d30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:19.983611 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4a53572f-5877-4afe-a427-e890ed353d30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:19.991625 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4a53572f-5877-4afe-a427-e890ed353d30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:19.992340 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4a53572f-5877-4afe-a427-e890ed353d30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:19.993457 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4a53572f-5877-4afe-a427-e890ed353d30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:19.994132 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4a53572f-5877-4afe-a427-e890ed353d30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:20.366595 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-4a53572f-5877-4afe-a427-e890ed353d30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:20.376060 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4a53572f-5877-4afe-a427-e890ed353d30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1677 microversion: 2.1 time: 0.396901 Dec 16 14:49:20.376633 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 498/977] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:19 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1677 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:21.394842 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-aa5d9a92-2980-43f8-809c-07f7cdf7c227 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:21.395727 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-aa5d9a92-2980-43f8-809c-07f7cdf7c227 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:21.403375 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aa5d9a92-2980-43f8-809c-07f7cdf7c227 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:21.403957 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aa5d9a92-2980-43f8-809c-07f7cdf7c227 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:21.404851 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aa5d9a92-2980-43f8-809c-07f7cdf7c227 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:21.405377 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-aa5d9a92-2980-43f8-809c-07f7cdf7c227 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:21.770396 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-aa5d9a92-2980-43f8-809c-07f7cdf7c227 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:21.778969 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-aa5d9a92-2980-43f8-809c-07f7cdf7c227 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1677 microversion: 2.1 time: 0.388464 Dec 16 14:49:21.779536 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 480/978] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:21 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1677 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:22.795593 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-aaecb71e-d5d0-47ce-aa03-8666930962e8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:22.796573 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-aaecb71e-d5d0-47ce-aa03-8666930962e8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:22.804053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aaecb71e-d5d0-47ce-aa03-8666930962e8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:22.804496 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aaecb71e-d5d0-47ce-aa03-8666930962e8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:22.805322 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aaecb71e-d5d0-47ce-aa03-8666930962e8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:22.805756 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-aaecb71e-d5d0-47ce-aa03-8666930962e8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:23.109199 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-aaecb71e-d5d0-47ce-aa03-8666930962e8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:23.119158 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-aaecb71e-d5d0-47ce-aa03-8666930962e8 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1677 microversion: 2.1 time: 0.327409 Dec 16 14:49:23.119732 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 499/979] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:22 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1677 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:24.137185 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-594d003a-a470-4054-9738-b625767156d6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:24.137810 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-594d003a-a470-4054-9738-b625767156d6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:24.145889 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-594d003a-a470-4054-9738-b625767156d6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:24.146440 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-594d003a-a470-4054-9738-b625767156d6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:24.147282 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-594d003a-a470-4054-9738-b625767156d6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:24.147793 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-594d003a-a470-4054-9738-b625767156d6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:24.512756 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-594d003a-a470-4054-9738-b625767156d6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:24.522116 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-594d003a-a470-4054-9738-b625767156d6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1677 microversion: 2.1 time: 0.388654 Dec 16 14:49:24.523126 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 481/980] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:24 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1677 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:25.539607 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c747c72f-b86e-4b57-b4b8-e432f8ab3679 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:25.540213 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c747c72f-b86e-4b57-b4b8-e432f8ab3679 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:25.548066 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c747c72f-b86e-4b57-b4b8-e432f8ab3679 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:25.548513 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c747c72f-b86e-4b57-b4b8-e432f8ab3679 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:25.549313 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c747c72f-b86e-4b57-b4b8-e432f8ab3679 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:25.549742 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c747c72f-b86e-4b57-b4b8-e432f8ab3679 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:25.901396 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c747c72f-b86e-4b57-b4b8-e432f8ab3679 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:25.910027 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c747c72f-b86e-4b57-b4b8-e432f8ab3679 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1677 microversion: 2.1 time: 0.374313 Dec 16 14:49:25.910609 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 500/981] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:25 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1677 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:26.927277 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-69baa17a-06f4-483d-8ad3-96fd6a32be01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:26.928005 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-69baa17a-06f4-483d-8ad3-96fd6a32be01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:26.935542 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69baa17a-06f4-483d-8ad3-96fd6a32be01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:26.936288 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69baa17a-06f4-483d-8ad3-96fd6a32be01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:26.937157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69baa17a-06f4-483d-8ad3-96fd6a32be01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:26.937662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69baa17a-06f4-483d-8ad3-96fd6a32be01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:27.335981 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-69baa17a-06f4-483d-8ad3-96fd6a32be01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:27.344035 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-69baa17a-06f4-483d-8ad3-96fd6a32be01 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1677 microversion: 2.1 time: 0.420393 Dec 16 14:49:27.344905 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 482/982] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:26 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1677 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:49:28.361026 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-cf324eb4-37da-4c95-8358-3717ff0290c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:28.361647 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-cf324eb4-37da-4c95-8358-3717ff0290c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:28.369088 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf324eb4-37da-4c95-8358-3717ff0290c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:28.369601 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf324eb4-37da-4c95-8358-3717ff0290c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:28.370493 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf324eb4-37da-4c95-8358-3717ff0290c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:28.370978 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-cf324eb4-37da-4c95-8358-3717ff0290c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:28.713985 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-cf324eb4-37da-4c95-8358-3717ff0290c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:28.723189 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-cf324eb4-37da-4c95-8358-3717ff0290c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1654 microversion: 2.1 time: 0.365895 Dec 16 14:49:28.734676 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 501/983] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:28 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1654 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:28.741393 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b836ab51-28a2-4a37-9cc3-904d20763488 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:28.750557 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b836ab51-28a2-4a37-9cc3-904d20763488 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:28.751326 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b836ab51-28a2-4a37-9cc3-904d20763488 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:28.813514 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b836ab51-28a2-4a37-9cc3-904d20763488 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Going to try to start instance {{(pid=101915) start /opt/stack/nova/nova/compute/api.py:2625}} Dec 16 14:49:29.064610 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b836ab51-28a2-4a37-9cc3-904d20763488 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action" status: 202 len: 0 microversion: 2.1 time: 0.327739 Dec 16 14:49:29.074433 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-220d2d56-af15-4b7f-9213-6aac66e92f56 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:29.075398 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-220d2d56-af15-4b7f-9213-6aac66e92f56 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:29.081287 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 483/984] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:49:28 2021] POST /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:49:29.096155 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-220d2d56-af15-4b7f-9213-6aac66e92f56 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:29.096943 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-220d2d56-af15-4b7f-9213-6aac66e92f56 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:29.098578 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-220d2d56-af15-4b7f-9213-6aac66e92f56 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:29.099245 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-220d2d56-af15-4b7f-9213-6aac66e92f56 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:29.403177 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-220d2d56-af15-4b7f-9213-6aac66e92f56 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:29.413852 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-220d2d56-af15-4b7f-9213-6aac66e92f56 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1663 microversion: 2.1 time: 0.343729 Dec 16 14:49:29.414919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 502/985] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:29 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1663 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:30.432050 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0f380f08-8a48-4e1f-9143-550a1f67b43e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:30.433346 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0f380f08-8a48-4e1f-9143-550a1f67b43e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:30.441036 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f380f08-8a48-4e1f-9143-550a1f67b43e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:30.441712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f380f08-8a48-4e1f-9143-550a1f67b43e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:30.442659 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f380f08-8a48-4e1f-9143-550a1f67b43e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:30.443254 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f380f08-8a48-4e1f-9143-550a1f67b43e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:30.744654 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-0f380f08-8a48-4e1f-9143-550a1f67b43e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:30.753062 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0f380f08-8a48-4e1f-9143-550a1f67b43e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1663 microversion: 2.1 time: 0.325100 Dec 16 14:49:30.753743 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 484/986] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:30 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1663 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:31.770335 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-6a1d9131-4ff9-4440-bd16-f40037780730 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:31.771014 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-6a1d9131-4ff9-4440-bd16-f40037780730 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:31.788379 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6a1d9131-4ff9-4440-bd16-f40037780730 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:31.788924 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6a1d9131-4ff9-4440-bd16-f40037780730 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:31.789761 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6a1d9131-4ff9-4440-bd16-f40037780730 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:31.790208 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6a1d9131-4ff9-4440-bd16-f40037780730 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:32.117174 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6a1d9131-4ff9-4440-bd16-f40037780730 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:32.125483 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-6a1d9131-4ff9-4440-bd16-f40037780730 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1667 microversion: 2.1 time: 0.358933 Dec 16 14:49:32.126263 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 503/987] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:31 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1667 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:37.760119 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-be5e3ffe-1f23-438d-8aa5-ef5b86c4da09 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Action: 'create', calling method: .version_select at 0x7f3c2cdcf700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1174908289"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:37.788010 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-be5e3ffe-1f23-438d-8aa5-ef5b86c4da09 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Getting quotas for project d963a0aa72964047885ee0212d5055dc. Resources: {'key_pairs'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:49:37.795786 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-be5e3ffe-1f23-438d-8aa5-ef5b86c4da09 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Getting quotas for user ee703ae6a79f48cdb9438f504085e206 and project d963a0aa72964047885ee0212d5055dc. Resources: {'key_pairs'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:49:37.977073 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-be5e3ffe-1f23-438d-8aa5-ef5b86c4da09 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Getting quotas for project d963a0aa72964047885ee0212d5055dc. Resources: {'key_pairs'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:49:37.980843 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-be5e3ffe-1f23-438d-8aa5-ef5b86c4da09 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Getting quotas for user ee703ae6a79f48cdb9438f504085e206 and project d963a0aa72964047885ee0212d5055dc. Resources: {'key_pairs'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:49:37.993853 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-be5e3ffe-1f23-438d-8aa5-ef5b86c4da09 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.406524 Dec 16 14:49:37.994613 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 485/988] 10.222.0.64 () {60 vars in 1157 bytes} [Thu Dec 16 14:49:37 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:49:56.289833 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-910884329", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1174908289", "security_groups": [{"name": "tempest-secgroup-smoke-1001105392"}], "block_device_mapping_v2": [{"uuid": "437d500d-845b-439f-931a-ad5c08b7de1e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9786e867-a38a-4109-abba-499d29f3c81d"}]}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:49:56.579578 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.network.neutron [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] validate_networks() for [('9786e867-a38a-4109-abba-499d29f3c81d', None, None, None)] {{(pid=101914) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:49:57.161241 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Flavor limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:49:57.161665 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Image limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:49:57.162643 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Flavor pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:49:57.163050 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Image pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:49:57.163461 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:49:57.171980 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:57.172402 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:57.173250 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:57.173926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:57.191503 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Getting quotas for project d963a0aa72964047885ee0212d5055dc. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:49:57.195823 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Getting quotas for user ee703ae6a79f48cdb9438f504085e206 and project d963a0aa72964047885ee0212d5055dc. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:49:57.296392 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Going to run 1 instances... {{(pid=101914) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:49:57.298810 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='437d500d-845b-439f-931a-ad5c08b7de1e',volume_size=None,volume_type=None)] {{(pid=101914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:49:57.463927 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [9323c51e-02d7-40d8-bea4-25fcfeaf1c57] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:49:58.484187 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [9323c51e-02d7-40d8-bea4-25fcfeaf1c57] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 58062. Dec 16 14:49:58.489466 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-82a72afa-5eca-426d-9763-b1abb521efdd tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.205363 Dec 16 14:49:58.490776 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 504/989] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:49:56 2021] POST /compute/v2.1/servers => generated 406 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:49:58.501308 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6e5fad26-3f24-460c-b48a-c112ddc4878e tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:58.501953 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6e5fad26-3f24-460c-b48a-c112ddc4878e tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:58.683666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-6e5fad26-3f24-460c-b48a-c112ddc4878e tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:58.691009 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6e5fad26-3f24-460c-b48a-c112ddc4878e tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1094 microversion: 2.1 time: 0.194246 Dec 16 14:49:58.691768 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 486/990] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:58 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1094 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:49:59.708653 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-63cc6a58-23ef-4c24-9f58-1ce10972afa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:49:59.709314 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-63cc6a58-23ef-4c24-9f58-1ce10972afa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:49:59.716765 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-63cc6a58-23ef-4c24-9f58-1ce10972afa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:59.717282 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-63cc6a58-23ef-4c24-9f58-1ce10972afa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:59.718058 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-63cc6a58-23ef-4c24-9f58-1ce10972afa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:49:59.718492 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-63cc6a58-23ef-4c24-9f58-1ce10972afa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:49:59.834329 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-63cc6a58-23ef-4c24-9f58-1ce10972afa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:49:59.842675 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-63cc6a58-23ef-4c24-9f58-1ce10972afa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1200 microversion: 2.1 time: 0.137860 Dec 16 14:49:59.843598 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 505/991] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:49:59 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1200 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:00.860359 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d22680ae-aa20-422f-bf77-2965910e79f4 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:00.861254 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d22680ae-aa20-422f-bf77-2965910e79f4 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:00.869588 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d22680ae-aa20-422f-bf77-2965910e79f4 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:00.870460 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d22680ae-aa20-422f-bf77-2965910e79f4 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:00.871543 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d22680ae-aa20-422f-bf77-2965910e79f4 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:00.882513 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d22680ae-aa20-422f-bf77-2965910e79f4 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:01.126828 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d22680ae-aa20-422f-bf77-2965910e79f4 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:01.136038 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d22680ae-aa20-422f-bf77-2965910e79f4 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1278 microversion: 2.1 time: 0.279268 Dec 16 14:50:01.136771 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 487/992] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:00 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1278 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:02.033145 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-6acad639-d14c-46d6-bbdc-4871e580cfea req-efab5c50-997f-468b-9c01-4199e6ac9dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2349104f-921f-4317-8b04-be3a09d2b6aa", "tag": "f680558f-d751-456d-a86d-c61c5e172d8d"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:02.035027 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:02.035027 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:50:02.043416 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-6acad639-d14c-46d6-bbdc-4871e580cfea req-efab5c50-997f-468b-9c01-4199e6ac9dfa service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:02.043862 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-6acad639-d14c-46d6-bbdc-4871e580cfea req-efab5c50-997f-468b-9c01-4199e6ac9dfa service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:02.062255 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-6acad639-d14c-46d6-bbdc-4871e580cfea req-efab5c50-997f-468b-9c01-4199e6ac9dfa service nova] Creating event network-changed:f680558f-d751-456d-a86d-c61c5e172d8d for instance 2349104f-921f-4317-8b04-be3a09d2b6aa on hv-cinder-82189 Dec 16 14:50:02.067277 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-6acad639-d14c-46d6-bbdc-4871e580cfea req-efab5c50-997f-468b-9c01-4199e6ac9dfa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105359 Dec 16 14:50:02.068070 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 506/993] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:02.153766 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-05270562-c6f3-4bfc-9a6f-6799474d1d77 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:02.154925 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-05270562-c6f3-4bfc-9a6f-6799474d1d77 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:02.162372 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-05270562-c6f3-4bfc-9a6f-6799474d1d77 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:02.162804 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-05270562-c6f3-4bfc-9a6f-6799474d1d77 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:02.163792 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-05270562-c6f3-4bfc-9a6f-6799474d1d77 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:02.164250 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-05270562-c6f3-4bfc-9a6f-6799474d1d77 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:02.373751 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-05270562-c6f3-4bfc-9a6f-6799474d1d77 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:02.382191 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-05270562-c6f3-4bfc-9a6f-6799474d1d77 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.232415 Dec 16 14:50:02.382776 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 488/994] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:02 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:03.400300 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-61c9863d-a43a-4d3a-bae6-fddcd73411d9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:03.401051 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-61c9863d-a43a-4d3a-bae6-fddcd73411d9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:03.408370 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-61c9863d-a43a-4d3a-bae6-fddcd73411d9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:03.408842 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-61c9863d-a43a-4d3a-bae6-fddcd73411d9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:03.409620 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-61c9863d-a43a-4d3a-bae6-fddcd73411d9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:03.410053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-61c9863d-a43a-4d3a-bae6-fddcd73411d9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:03.608932 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-61c9863d-a43a-4d3a-bae6-fddcd73411d9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:03.617452 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-61c9863d-a43a-4d3a-bae6-fddcd73411d9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.221936 Dec 16 14:50:03.618019 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 507/995] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:03 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:04.641774 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b0f1b705-6710-4c4c-8956-92083810d167 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:04.642376 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b0f1b705-6710-4c4c-8956-92083810d167 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:04.649623 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b0f1b705-6710-4c4c-8956-92083810d167 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:04.650077 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b0f1b705-6710-4c4c-8956-92083810d167 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:04.650856 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b0f1b705-6710-4c4c-8956-92083810d167 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:04.651295 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b0f1b705-6710-4c4c-8956-92083810d167 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:04.843235 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b0f1b705-6710-4c4c-8956-92083810d167 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:04.851874 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b0f1b705-6710-4c4c-8956-92083810d167 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.213777 Dec 16 14:50:04.852437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 489/996] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:04 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:05.868539 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9299aa73-2d66-43d8-a80c-7880817269a3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:05.869172 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9299aa73-2d66-43d8-a80c-7880817269a3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:05.876678 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9299aa73-2d66-43d8-a80c-7880817269a3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:05.877159 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9299aa73-2d66-43d8-a80c-7880817269a3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:05.877918 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9299aa73-2d66-43d8-a80c-7880817269a3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:05.878361 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9299aa73-2d66-43d8-a80c-7880817269a3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:06.079752 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9299aa73-2d66-43d8-a80c-7880817269a3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:06.088214 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9299aa73-2d66-43d8-a80c-7880817269a3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.223931 Dec 16 14:50:06.088841 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 508/997] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:05 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:07.105313 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-99d8ebd1-883e-4404-815d-e5553ba329ad tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:07.105914 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-99d8ebd1-883e-4404-815d-e5553ba329ad tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:07.115047 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-99d8ebd1-883e-4404-815d-e5553ba329ad tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:07.115499 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-99d8ebd1-883e-4404-815d-e5553ba329ad tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:07.116869 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-99d8ebd1-883e-4404-815d-e5553ba329ad tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:07.117304 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-99d8ebd1-883e-4404-815d-e5553ba329ad tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:07.308895 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-99d8ebd1-883e-4404-815d-e5553ba329ad tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:07.316956 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-99d8ebd1-883e-4404-815d-e5553ba329ad tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.215300 Dec 16 14:50:07.317517 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 490/998] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:07 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:08.339357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3857b3a6-194b-4d9b-8ecf-0109803e3e12 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:08.339962 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3857b3a6-194b-4d9b-8ecf-0109803e3e12 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:08.347133 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3857b3a6-194b-4d9b-8ecf-0109803e3e12 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:08.347572 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3857b3a6-194b-4d9b-8ecf-0109803e3e12 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:08.348333 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3857b3a6-194b-4d9b-8ecf-0109803e3e12 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:08.348757 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3857b3a6-194b-4d9b-8ecf-0109803e3e12 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:08.543875 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3857b3a6-194b-4d9b-8ecf-0109803e3e12 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:08.552327 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3857b3a6-194b-4d9b-8ecf-0109803e3e12 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.216634 Dec 16 14:50:08.552907 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 509/999] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:08 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:09.569171 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4bca0707-82fe-49f9-aadf-b9de95a9cf67 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:09.569771 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4bca0707-82fe-49f9-aadf-b9de95a9cf67 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:09.577035 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4bca0707-82fe-49f9-aadf-b9de95a9cf67 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:09.577487 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4bca0707-82fe-49f9-aadf-b9de95a9cf67 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:09.578243 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4bca0707-82fe-49f9-aadf-b9de95a9cf67 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:09.578684 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4bca0707-82fe-49f9-aadf-b9de95a9cf67 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:09.785899 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4bca0707-82fe-49f9-aadf-b9de95a9cf67 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:09.794735 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4bca0707-82fe-49f9-aadf-b9de95a9cf67 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.229260 Dec 16 14:50:09.795291 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 491/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:09 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:50:10.526740 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b89dbf69-69b2-49a0-a4fc-5e88002b39b1 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:10.527690 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b89dbf69-69b2-49a0-a4fc-5e88002b39b1 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:10.534973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b89dbf69-69b2-49a0-a4fc-5e88002b39b1 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:10.535424 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b89dbf69-69b2-49a0-a4fc-5e88002b39b1 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:10.536193 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b89dbf69-69b2-49a0-a4fc-5e88002b39b1 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:10.536630 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b89dbf69-69b2-49a0-a4fc-5e88002b39b1 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:10.598721 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b89dbf69-69b2-49a0-a4fc-5e88002b39b1 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075748 Dec 16 14:50:10.599269 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 510/1001] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:50:10 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:10.696362 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-10caa50a-bdd0-4c95-9db2-b81441bb891d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:10.696879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-10caa50a-bdd0-4c95-9db2-b81441bb891d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:10.704248 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-10caa50a-bdd0-4c95-9db2-b81441bb891d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:10.704690 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-10caa50a-bdd0-4c95-9db2-b81441bb891d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:10.705495 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-10caa50a-bdd0-4c95-9db2-b81441bb891d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:10.705930 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-10caa50a-bdd0-4c95-9db2-b81441bb891d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:10.765958 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-10caa50a-bdd0-4c95-9db2-b81441bb891d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:50:10.811249 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d9429ee5-5e1b-44d0-87f1-ec4d958c90a7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:10.811853 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-d9429ee5-5e1b-44d0-87f1-ec4d958c90a7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:10.819100 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d9429ee5-5e1b-44d0-87f1-ec4d958c90a7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:10.819549 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d9429ee5-5e1b-44d0-87f1-ec4d958c90a7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:10.820319 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d9429ee5-5e1b-44d0-87f1-ec4d958c90a7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:10.820760 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-d9429ee5-5e1b-44d0-87f1-ec4d958c90a7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:10.891476 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-10caa50a-bdd0-4c95-9db2-b81441bb891d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 204 len: 0 microversion: 2.1 time: 0.198639 Dec 16 14:50:10.892067 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 492/1002] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:50:10 2021] DELETE /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:50:10.901909 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-948de5ec-bb05-4cdd-8dff-cb08a1625805 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:10.902898 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-948de5ec-bb05-4cdd-8dff-cb08a1625805 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:10.910129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-948de5ec-bb05-4cdd-8dff-cb08a1625805 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:10.910579 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-948de5ec-bb05-4cdd-8dff-cb08a1625805 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:10.911347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-948de5ec-bb05-4cdd-8dff-cb08a1625805 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:10.911779 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-948de5ec-bb05-4cdd-8dff-cb08a1625805 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:11.159124 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-d9429ee5-5e1b-44d0-87f1-ec4d958c90a7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:11.168601 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d9429ee5-5e1b-44d0-87f1-ec4d958c90a7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.360918 Dec 16 14:50:11.169195 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 511/1003] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:10 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:50:11.240162 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-948de5ec-bb05-4cdd-8dff-cb08a1625805 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:11.249004 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-948de5ec-bb05-4cdd-8dff-cb08a1625805 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1673 microversion: 2.1 time: 0.352174 Dec 16 14:50:11.249589 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 493/1004] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:10 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1673 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:50:12.185472 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-207e8a0a-2711-49bf-8e2e-aabc4b8b3a99 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:12.186075 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-207e8a0a-2711-49bf-8e2e-aabc4b8b3a99 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:12.193334 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-207e8a0a-2711-49bf-8e2e-aabc4b8b3a99 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:12.193779 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-207e8a0a-2711-49bf-8e2e-aabc4b8b3a99 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:12.195044 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-207e8a0a-2711-49bf-8e2e-aabc4b8b3a99 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:12.195472 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-207e8a0a-2711-49bf-8e2e-aabc4b8b3a99 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:12.265849 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e1b22f44-ef94-4855-9208-e27aca0d971b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:12.266542 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e1b22f44-ef94-4855-9208-e27aca0d971b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:12.274826 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e1b22f44-ef94-4855-9208-e27aca0d971b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:12.275355 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e1b22f44-ef94-4855-9208-e27aca0d971b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:12.276199 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e1b22f44-ef94-4855-9208-e27aca0d971b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:12.276704 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e1b22f44-ef94-4855-9208-e27aca0d971b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:12.438460 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-207e8a0a-2711-49bf-8e2e-aabc4b8b3a99 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:12.448656 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-207e8a0a-2711-49bf-8e2e-aabc4b8b3a99 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.266728 Dec 16 14:50:12.449268 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 512/1005] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:12 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:12.509472 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e1b22f44-ef94-4855-9208-e27aca0d971b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:12.517524 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e1b22f44-ef94-4855-9208-e27aca0d971b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1673 microversion: 2.1 time: 0.255323 Dec 16 14:50:12.518082 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 494/1006] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:12 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1673 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:50:13.418427 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-660b8ed0-2a48-48b1-bd87-52304b92b69a req-69cf95f2-9d5b-4794-b097-348f2bf0381b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2349104f-921f-4317-8b04-be3a09d2b6aa", "name": "network-vif-plugged", "status": "completed", "tag": "f680558f-d751-456d-a86d-c61c5e172d8d"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:13.420378 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:13.420378 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:50:13.429698 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-660b8ed0-2a48-48b1-bd87-52304b92b69a req-69cf95f2-9d5b-4794-b097-348f2bf0381b service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:13.430385 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-660b8ed0-2a48-48b1-bd87-52304b92b69a req-69cf95f2-9d5b-4794-b097-348f2bf0381b service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:13.454040 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-660b8ed0-2a48-48b1-bd87-52304b92b69a req-69cf95f2-9d5b-4794-b097-348f2bf0381b service nova] Creating event network-vif-plugged:f680558f-d751-456d-a86d-c61c5e172d8d for instance 2349104f-921f-4317-8b04-be3a09d2b6aa on hv-cinder-82189 Dec 16 14:50:13.458954 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-660b8ed0-2a48-48b1-bd87-52304b92b69a req-69cf95f2-9d5b-4794-b097-348f2bf0381b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102011 Dec 16 14:50:13.460451 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 513/1007] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:50:13.465746 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fff34d4a-b8ac-4bc3-bab7-9c5955341825 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:13.466367 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fff34d4a-b8ac-4bc3-bab7-9c5955341825 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:13.473684 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fff34d4a-b8ac-4bc3-bab7-9c5955341825 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:13.474125 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fff34d4a-b8ac-4bc3-bab7-9c5955341825 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:13.474892 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fff34d4a-b8ac-4bc3-bab7-9c5955341825 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:13.475994 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fff34d4a-b8ac-4bc3-bab7-9c5955341825 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:13.536927 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b35e984c-048e-44db-b7b1-991fa3f2475a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:13.538412 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b35e984c-048e-44db-b7b1-991fa3f2475a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:13.546838 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b35e984c-048e-44db-b7b1-991fa3f2475a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:13.547451 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b35e984c-048e-44db-b7b1-991fa3f2475a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:13.548430 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b35e984c-048e-44db-b7b1-991fa3f2475a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:13.549015 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b35e984c-048e-44db-b7b1-991fa3f2475a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:13.794181 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fff34d4a-b8ac-4bc3-bab7-9c5955341825 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:13.802921 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fff34d4a-b8ac-4bc3-bab7-9c5955341825 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.340636 Dec 16 14:50:13.803509 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 495/1008] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:13 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:13.874857 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b35e984c-048e-44db-b7b1-991fa3f2475a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:13.895924 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b35e984c-048e-44db-b7b1-991fa3f2475a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1673 microversion: 2.1 time: 0.364299 Dec 16 14:50:13.896858 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 514/1009] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:13 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1673 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:14.439088 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-3091ccc8-3210-42d3-a8db-6dd7c5e64b64 req-1e8c4672-920f-4ff4-bf3c-7e4002384de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21eb2e8-5685-4000-b8c6-edb7fb5daa68", "name": "network-vif-deleted", "tag": "71ec40cc-e92b-4e94-8b04-7b26de75bfbb"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:14.441051 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:14.441051 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:50:14.450202 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-3091ccc8-3210-42d3-a8db-6dd7c5e64b64 req-1e8c4672-920f-4ff4-bf3c-7e4002384de8 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:14.450583 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-3091ccc8-3210-42d3-a8db-6dd7c5e64b64 req-1e8c4672-920f-4ff4-bf3c-7e4002384de8 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:14.466868 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-3091ccc8-3210-42d3-a8db-6dd7c5e64b64 req-1e8c4672-920f-4ff4-bf3c-7e4002384de8 service nova] Creating event network-vif-deleted:71ec40cc-e92b-4e94-8b04-7b26de75bfbb for instance e21eb2e8-5685-4000-b8c6-edb7fb5daa68 on hv-cinder-82189 Dec 16 14:50:14.471527 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-3091ccc8-3210-42d3-a8db-6dd7c5e64b64 req-1e8c4672-920f-4ff4-bf3c-7e4002384de8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036091 Dec 16 14:50:14.472318 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 496/1010] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:14.819949 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-81f1d15e-c127-4792-a4ad-d251ab51bb51 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:14.820707 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-81f1d15e-c127-4792-a4ad-d251ab51bb51 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:14.828085 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-81f1d15e-c127-4792-a4ad-d251ab51bb51 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:14.828540 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-81f1d15e-c127-4792-a4ad-d251ab51bb51 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:14.829357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-81f1d15e-c127-4792-a4ad-d251ab51bb51 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:14.829796 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-81f1d15e-c127-4792-a4ad-d251ab51bb51 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:14.917373 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:14.918359 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:14.926646 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:14.927378 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:14.928893 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:14.929492 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:15.018757 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:15.019679 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:15.020429 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lazy-loading 'fault' on Instance uuid e21eb2e8-5685-4000-b8c6-edb7fb5daa68 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:50:15.092097 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:15.094493 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-81f1d15e-c127-4792-a4ad-d251ab51bb51 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:15.102970 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4449ff37-6493-430a-891d-2d112f2cfa57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 200 len: 1326 microversion: 2.1 time: 0.191095 Dec 16 14:50:15.103582 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-81f1d15e-c127-4792-a4ad-d251ab51bb51 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1266 microversion: 2.1 time: 0.287944 Dec 16 14:50:15.113252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 515/1011] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:14 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:15.114070 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 497/1012] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:14 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 1326 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:16.120363 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e47db2c6-c81a-4cf7-a49e-4be151821c97 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:16.120959 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-67aca047-0d91-4425-a839-8da98b626451 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:16.121341 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e47db2c6-c81a-4cf7-a49e-4be151821c97 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:16.121445 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-67aca047-0d91-4425-a839-8da98b626451 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:16.128187 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e47db2c6-c81a-4cf7-a49e-4be151821c97 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:16.128352 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-67aca047-0d91-4425-a839-8da98b626451 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:16.128631 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e47db2c6-c81a-4cf7-a49e-4be151821c97 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:16.128757 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-67aca047-0d91-4425-a839-8da98b626451 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:16.129424 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e47db2c6-c81a-4cf7-a49e-4be151821c97 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:16.129544 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-67aca047-0d91-4425-a839-8da98b626451 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:16.129852 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e47db2c6-c81a-4cf7-a49e-4be151821c97 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:16.129978 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-67aca047-0d91-4425-a839-8da98b626451 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:16.180071 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-67aca047-0d91-4425-a839-8da98b626451 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] HTTP exception thrown: Instance e21eb2e8-5685-4000-b8c6-edb7fb5daa68 could not be found. Dec 16 14:50:16.180575 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-67aca047-0d91-4425-a839-8da98b626451 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Returning 404 to user: Instance e21eb2e8-5685-4000-b8c6-edb7fb5daa68 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:50:16.181429 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-67aca047-0d91-4425-a839-8da98b626451 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 404 len: 111 microversion: 2.1 time: 0.064767 Dec 16 14:50:16.181989 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 498/1013] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:16 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:50:16.189823 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4a3d687f-b56c-4f39-ad63-0a67eb2e7d57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '.version_select at 0x7f3c2ce90a60>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:16.208719 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4a3d687f-b56c-4f39-ad63-0a67eb2e7d57 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-931247866" status: 202 len: 0 microversion: 2.1 time: 0.022221 Dec 16 14:50:16.209329 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 499/1014] 10.222.0.64 () {58 vars in 1217 bytes} [Thu Dec 16 14:50:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-931247866 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:50:16.329538 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e47db2c6-c81a-4cf7-a49e-4be151821c97 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:16.337675 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e47db2c6-c81a-4cf7-a49e-4be151821c97 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1452 microversion: 2.1 time: 0.220965 Dec 16 14:50:16.338233 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 516/1015] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:16 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1452 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:50:16.353584 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-30aba2c2-1e6f-4d3f-b6c2-2345dbab7e7d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:16.354193 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-30aba2c2-1e6f-4d3f-b6c2-2345dbab7e7d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:16.362358 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-30aba2c2-1e6f-4d3f-b6c2-2345dbab7e7d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:16.362906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-30aba2c2-1e6f-4d3f-b6c2-2345dbab7e7d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:16.363849 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-30aba2c2-1e6f-4d3f-b6c2-2345dbab7e7d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:16.364382 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-30aba2c2-1e6f-4d3f-b6c2-2345dbab7e7d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:16.565767 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-30aba2c2-1e6f-4d3f-b6c2-2345dbab7e7d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:16.574414 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-30aba2c2-1e6f-4d3f-b6c2-2345dbab7e7d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1452 microversion: 2.1 time: 0.224474 Dec 16 14:50:16.574995 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 500/1016] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:16 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:17.239064 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-cab7d11d-6ca9-47a0-84e0-d70791fed3eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'create', calling method: .version_select at 0x7f3c2c3965e0>, body: {"keypair": {"name": "tempest-keypair-1497082308"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:17.260867 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-cab7d11d-6ca9-47a0-84e0-d70791fed3eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:50:17.264824 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-cab7d11d-6ca9-47a0-84e0-d70791fed3eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for user 48319d5dcda64acebea9bb3daad1889b and project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:50:17.894380 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-cab7d11d-6ca9-47a0-84e0-d70791fed3eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:50:17.898960 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-cab7d11d-6ca9-47a0-84e0-d70791fed3eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for user 48319d5dcda64acebea9bb3daad1889b and project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'key_pairs'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:50:17.914145 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-cab7d11d-6ca9-47a0-84e0-d70791fed3eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.680730 Dec 16 14:50:17.915124 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 517/1017] 10.222.0.64 () {60 vars in 1157 bytes} [Thu Dec 16 14:50:17 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:19.229326 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-0264a4ee-a42d-402d-8d51-df69148d656d req-ef9223f1-39fe-4df1-aab5-ede1a3aa4074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2349104f-921f-4317-8b04-be3a09d2b6aa", "tag": "f680558f-d751-456d-a86d-c61c5e172d8d"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:19.234533 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:19.234533 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:50:19.242088 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-0264a4ee-a42d-402d-8d51-df69148d656d req-ef9223f1-39fe-4df1-aab5-ede1a3aa4074 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:19.242780 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-0264a4ee-a42d-402d-8d51-df69148d656d req-ef9223f1-39fe-4df1-aab5-ede1a3aa4074 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:19.261432 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-0264a4ee-a42d-402d-8d51-df69148d656d req-ef9223f1-39fe-4df1-aab5-ede1a3aa4074 service nova] Creating event network-changed:f680558f-d751-456d-a86d-c61c5e172d8d for instance 2349104f-921f-4317-8b04-be3a09d2b6aa on hv-cinder-82189 Dec 16 14:50:19.266665 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-0264a4ee-a42d-402d-8d51-df69148d656d req-ef9223f1-39fe-4df1-aab5-ede1a3aa4074 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097853 Dec 16 14:50:19.267579 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 501/1018] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:20.074182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1941024779", "imageRef": "ace7331a-3b53-4814-8ffa-afd86331ce75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e2c3c82-d885-4e17-97cb-7ea9c8e597d5"}], "security_groups": [{"name": "tempest-securitygroup--632887967"}], "key_name": "tempest-keypair-1497082308", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:20.196053 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.network.neutron [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] validate_networks() for [('8e2c3c82-d885-4e17-97cb-7ea9c8e597d5', None, None, None)] {{(pid=101914) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:50:20.749009 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Flavor limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:50:20.749424 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Image limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:50:20.749889 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Flavor pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:50:20.750292 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Image pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:50:20.750696 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:50:20.759562 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:20.760001 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:20.760954 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:20.761314 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:20.778166 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:50:20.782344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Getting quotas for user 48319d5dcda64acebea9bb3daad1889b and project bb0a577a94a04b3eaaaf2d2347f21e44. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:50:20.792875 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Going to run 1 instances... {{(pid=101914) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:50:20.795156 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ace7331a-3b53-4814-8ffa-afd86331ce75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:50:20.840360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-edffa3c9-e84e-4f37-9c05-53d9d4155526 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.770178 Dec 16 14:50:20.841243 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 518/1019] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:50:20 2021] POST /compute/v2.1/servers => generated 401 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:50:20.851571 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fa743084-185b-4e3d-92ae-219db755c380 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:20.852275 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fa743084-185b-4e3d-92ae-219db755c380 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:20.929279 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-fa743084-185b-4e3d-92ae-219db755c380 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:20.937080 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fa743084-185b-4e3d-92ae-219db755c380 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1238 microversion: 2.1 time: 0.089550 Dec 16 14:50:20.937816 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 502/1020] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:20 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:50:21.953708 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e350d131-a79f-4143-840a-0e72b2813253 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:21.954972 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e350d131-a79f-4143-840a-0e72b2813253 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:21.964499 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e350d131-a79f-4143-840a-0e72b2813253 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:21.965264 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e350d131-a79f-4143-840a-0e72b2813253 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:21.966226 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e350d131-a79f-4143-840a-0e72b2813253 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:21.968156 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e350d131-a79f-4143-840a-0e72b2813253 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:22.109175 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-e350d131-a79f-4143-840a-0e72b2813253 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:22.117240 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e350d131-a79f-4143-840a-0e72b2813253 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1308 microversion: 2.1 time: 0.167189 Dec 16 14:50:22.117782 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 519/1021] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:21 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:23.137880 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-93358933-1abc-4136-a855-f2d1cd9c973c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:23.138652 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-93358933-1abc-4136-a855-f2d1cd9c973c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:23.164538 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93358933-1abc-4136-a855-f2d1cd9c973c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:23.165233 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93358933-1abc-4136-a855-f2d1cd9c973c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:23.166094 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93358933-1abc-4136-a855-f2d1cd9c973c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:23.166674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-93358933-1abc-4136-a855-f2d1cd9c973c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:23.633758 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-93358933-1abc-4136-a855-f2d1cd9c973c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:23.641793 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-93358933-1abc-4136-a855-f2d1cd9c973c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1363 microversion: 2.1 time: 0.510991 Dec 16 14:50:23.642359 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 503/1022] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:23 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1363 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:24.073613 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-19615e9d-00c2-4b7a-8751-0ed120ac5721 req-884760d5-9127-4479-8794-f35ec5879fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4afe80a2-2118-448f-870e-b4b3798ca297", "tag": "d43ffe48-4dfa-4c03-80bb-fc3cbc8fc888"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:24.076120 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:24.076120 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:50:24.087442 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-19615e9d-00c2-4b7a-8751-0ed120ac5721 req-884760d5-9127-4479-8794-f35ec5879fcd service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:24.088064 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-19615e9d-00c2-4b7a-8751-0ed120ac5721 req-884760d5-9127-4479-8794-f35ec5879fcd service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:24.105204 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-19615e9d-00c2-4b7a-8751-0ed120ac5721 req-884760d5-9127-4479-8794-f35ec5879fcd service nova] Creating event network-changed:d43ffe48-4dfa-4c03-80bb-fc3cbc8fc888 for instance 4afe80a2-2118-448f-870e-b4b3798ca297 on hv-cinder-82189 Dec 16 14:50:24.110085 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-19615e9d-00c2-4b7a-8751-0ed120ac5721 req-884760d5-9127-4479-8794-f35ec5879fcd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041015 Dec 16 14:50:24.110784 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 520/1023] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:24.659304 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0596be44-bfa0-46b6-89ea-52b890538dac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:24.659997 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0596be44-bfa0-46b6-89ea-52b890538dac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:24.667309 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0596be44-bfa0-46b6-89ea-52b890538dac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:24.667752 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0596be44-bfa0-46b6-89ea-52b890538dac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:24.668524 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0596be44-bfa0-46b6-89ea-52b890538dac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:24.668984 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0596be44-bfa0-46b6-89ea-52b890538dac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:24.922483 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-0596be44-bfa0-46b6-89ea-52b890538dac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:24.931631 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0596be44-bfa0-46b6-89ea-52b890538dac tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1363 microversion: 2.1 time: 0.276045 Dec 16 14:50:24.932291 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 504/1024] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:24 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:25.953610 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-6d179bb6-5b40-41b6-92e6-dbe2b56383e5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:25.954467 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-6d179bb6-5b40-41b6-92e6-dbe2b56383e5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:25.962671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6d179bb6-5b40-41b6-92e6-dbe2b56383e5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:25.963116 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6d179bb6-5b40-41b6-92e6-dbe2b56383e5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:25.963907 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6d179bb6-5b40-41b6-92e6-dbe2b56383e5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:25.964322 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-6d179bb6-5b40-41b6-92e6-dbe2b56383e5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:26.159376 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-6d179bb6-5b40-41b6-92e6-dbe2b56383e5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:26.167961 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-6d179bb6-5b40-41b6-92e6-dbe2b56383e5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1363 microversion: 2.1 time: 0.221676 Dec 16 14:50:26.168524 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 521/1025] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:25 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:27.184537 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8a672d68-b385-40b1-bc21-86a7e6a1e94e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:27.185106 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8a672d68-b385-40b1-bc21-86a7e6a1e94e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:27.193337 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a672d68-b385-40b1-bc21-86a7e6a1e94e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:27.193781 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a672d68-b385-40b1-bc21-86a7e6a1e94e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:27.195190 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a672d68-b385-40b1-bc21-86a7e6a1e94e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:27.195613 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a672d68-b385-40b1-bc21-86a7e6a1e94e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:27.389506 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8a672d68-b385-40b1-bc21-86a7e6a1e94e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:27.398517 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8a672d68-b385-40b1-bc21-86a7e6a1e94e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1363 microversion: 2.1 time: 0.217088 Dec 16 14:50:27.399083 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 505/1026] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:27 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:28.415928 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5d08978d-ac32-4aab-99e6-0c1025122ee0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:28.416523 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5d08978d-ac32-4aab-99e6-0c1025122ee0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:28.423787 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5d08978d-ac32-4aab-99e6-0c1025122ee0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:28.424235 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5d08978d-ac32-4aab-99e6-0c1025122ee0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:28.425038 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5d08978d-ac32-4aab-99e6-0c1025122ee0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:28.425725 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5d08978d-ac32-4aab-99e6-0c1025122ee0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:28.620020 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5d08978d-ac32-4aab-99e6-0c1025122ee0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:28.627925 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5d08978d-ac32-4aab-99e6-0c1025122ee0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1363 microversion: 2.1 time: 0.216473 Dec 16 14:50:28.628481 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 522/1027] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:28 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:29.426195 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-b3bd6be8-ea2d-405a-bdea-30d5678a128a req-84cdf1cb-2604-47c2-bd43-7520b6df1321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afe80a2-2118-448f-870e-b4b3798ca297", "name": "network-vif-plugged", "status": "completed", "tag": "d43ffe48-4dfa-4c03-80bb-fc3cbc8fc888"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:29.427852 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:29.427852 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:50:29.436842 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-b3bd6be8-ea2d-405a-bdea-30d5678a128a req-84cdf1cb-2604-47c2-bd43-7520b6df1321 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:29.437284 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-b3bd6be8-ea2d-405a-bdea-30d5678a128a req-84cdf1cb-2604-47c2-bd43-7520b6df1321 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:29.452699 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-b3bd6be8-ea2d-405a-bdea-30d5678a128a req-84cdf1cb-2604-47c2-bd43-7520b6df1321 service nova] Creating event network-vif-plugged:d43ffe48-4dfa-4c03-80bb-fc3cbc8fc888 for instance 4afe80a2-2118-448f-870e-b4b3798ca297 on hv-cinder-82189 Dec 16 14:50:29.457487 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-b3bd6be8-ea2d-405a-bdea-30d5678a128a req-84cdf1cb-2604-47c2-bd43-7520b6df1321 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035115 Dec 16 14:50:29.458172 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 506/1028] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:29.645837 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3fbac8c7-95fc-4905-8307-3f3e9d1b283c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:29.646450 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3fbac8c7-95fc-4905-8307-3f3e9d1b283c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:29.655451 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3fbac8c7-95fc-4905-8307-3f3e9d1b283c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:29.655902 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3fbac8c7-95fc-4905-8307-3f3e9d1b283c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:29.656676 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3fbac8c7-95fc-4905-8307-3f3e9d1b283c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:29.657128 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3fbac8c7-95fc-4905-8307-3f3e9d1b283c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:29.910288 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3fbac8c7-95fc-4905-8307-3f3e9d1b283c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:29.918944 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3fbac8c7-95fc-4905-8307-3f3e9d1b283c tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1363 microversion: 2.1 time: 0.277901 Dec 16 14:50:29.919510 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 523/1029] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:29 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:30.936080 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ee066850-91c2-413e-992b-f823c8663c76 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:30.936805 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ee066850-91c2-413e-992b-f823c8663c76 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:30.944351 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee066850-91c2-413e-992b-f823c8663c76 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:30.945332 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee066850-91c2-413e-992b-f823c8663c76 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:30.946101 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee066850-91c2-413e-992b-f823c8663c76 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:30.946537 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ee066850-91c2-413e-992b-f823c8663c76 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:31.155968 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-ee066850-91c2-413e-992b-f823c8663c76 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:31.163993 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ee066850-91c2-413e-992b-f823c8663c76 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1363 microversion: 2.1 time: 0.232165 Dec 16 14:50:31.164543 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 507/1030] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:30 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:32.180847 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-10030b46-4be5-4378-9610-01bf6b865994 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:32.181430 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-10030b46-4be5-4378-9610-01bf6b865994 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:32.188699 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-10030b46-4be5-4378-9610-01bf6b865994 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:32.189171 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-10030b46-4be5-4378-9610-01bf6b865994 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:32.189918 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-10030b46-4be5-4378-9610-01bf6b865994 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:32.190341 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-10030b46-4be5-4378-9610-01bf6b865994 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:32.385048 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-10030b46-4be5-4378-9610-01bf6b865994 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:50:32.393213 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-10030b46-4be5-4378-9610-01bf6b865994 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1550 microversion: 2.1 time: 0.216140 Dec 16 14:50:32.393807 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 524/1031] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:50:32 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1550 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:32.409731 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3fa166ab-8626-4781-b902-76ed2d034dc6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:50:32.410252 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3fa166ab-8626-4781-b902-76ed2d034dc6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:32.417401 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3fa166ab-8626-4781-b902-76ed2d034dc6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:32.417846 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3fa166ab-8626-4781-b902-76ed2d034dc6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:32.418600 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3fa166ab-8626-4781-b902-76ed2d034dc6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:32.419030 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3fa166ab-8626-4781-b902-76ed2d034dc6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:32.560725 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3fa166ab-8626-4781-b902-76ed2d034dc6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154604 Dec 16 14:50:32.561363 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 508/1032] 10.222.0.64 () {58 vars in 1274 bytes} [Thu Dec 16 14:50:32 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:50:34.133682 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ac939a2b-2f2c-435b-93c5-977a0278acb9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:34.134591 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ac939a2b-2f2c-435b-93c5-977a0278acb9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:34.136529 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-dd34980c-df61-415d-9f84-14da1b53aae5 req-695e2115-8138-4120-a077-f96835240f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4afe80a2-2118-448f-870e-b4b3798ca297", "tag": "d43ffe48-4dfa-4c03-80bb-fc3cbc8fc888"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:34.138714 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:50:34.138714 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:50:34.141928 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ac939a2b-2f2c-435b-93c5-977a0278acb9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:34.142376 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ac939a2b-2f2c-435b-93c5-977a0278acb9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:34.143150 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ac939a2b-2f2c-435b-93c5-977a0278acb9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:34.143946 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ac939a2b-2f2c-435b-93c5-977a0278acb9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:34.147250 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-dd34980c-df61-415d-9f84-14da1b53aae5 req-695e2115-8138-4120-a077-f96835240f94 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:34.147695 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-dd34980c-df61-415d-9f84-14da1b53aae5 req-695e2115-8138-4120-a077-f96835240f94 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:34.164890 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-dd34980c-df61-415d-9f84-14da1b53aae5 req-695e2115-8138-4120-a077-f96835240f94 service nova] Creating event network-changed:d43ffe48-4dfa-4c03-80bb-fc3cbc8fc888 for instance 4afe80a2-2118-448f-870e-b4b3798ca297 on hv-cinder-82189 Dec 16 14:50:34.169751 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-dd34980c-df61-415d-9f84-14da1b53aae5 req-695e2115-8138-4120-a077-f96835240f94 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037263 Dec 16 14:50:34.170700 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 509/1033] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:50:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:50:34.257871 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ac939a2b-2f2c-435b-93c5-977a0278acb9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 14 microversion: 2.1 time: 0.127500 Dec 16 14:50:34.261368 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 525/1034] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:34 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:35.269731 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d28201c0-f814-4f2d-a7a2-8a9a576d7f82 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:35.270740 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d28201c0-f814-4f2d-a7a2-8a9a576d7f82 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:35.278301 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d28201c0-f814-4f2d-a7a2-8a9a576d7f82 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:35.278769 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d28201c0-f814-4f2d-a7a2-8a9a576d7f82 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:35.279575 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d28201c0-f814-4f2d-a7a2-8a9a576d7f82 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:35.280005 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d28201c0-f814-4f2d-a7a2-8a9a576d7f82 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:35.404735 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d28201c0-f814-4f2d-a7a2-8a9a576d7f82 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 14 microversion: 2.1 time: 0.138958 Dec 16 14:50:35.406758 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 510/1035] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:35 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:36.416602 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0eb7ae1d-2e02-422a-8298-8ef6e7fa3dfd tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:36.417668 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0eb7ae1d-2e02-422a-8298-8ef6e7fa3dfd tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:36.426291 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0eb7ae1d-2e02-422a-8298-8ef6e7fa3dfd tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:36.426631 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0eb7ae1d-2e02-422a-8298-8ef6e7fa3dfd tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:36.427404 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0eb7ae1d-2e02-422a-8298-8ef6e7fa3dfd tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:36.427838 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0eb7ae1d-2e02-422a-8298-8ef6e7fa3dfd tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:36.547930 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0eb7ae1d-2e02-422a-8298-8ef6e7fa3dfd tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 14 microversion: 2.1 time: 0.135824 Dec 16 14:50:36.548572 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 526/1036] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:36 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:37.559316 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-6d3a0541-1939-4737-a9b1-e0b079d19d86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:37.560344 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-6d3a0541-1939-4737-a9b1-e0b079d19d86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:37.568224 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d3a0541-1939-4737-a9b1-e0b079d19d86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:37.568670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d3a0541-1939-4737-a9b1-e0b079d19d86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:37.569463 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d3a0541-1939-4737-a9b1-e0b079d19d86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:37.569895 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-6d3a0541-1939-4737-a9b1-e0b079d19d86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:37.694014 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-6d3a0541-1939-4737-a9b1-e0b079d19d86 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 14 microversion: 2.1 time: 0.138631 Dec 16 14:50:37.694640 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 511/1037] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:37 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:38.705967 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-67c5cb2c-4865-45e3-940e-d165676150c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:38.707458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-67c5cb2c-4865-45e3-940e-d165676150c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:38.715616 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-67c5cb2c-4865-45e3-940e-d165676150c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.716176 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-67c5cb2c-4865-45e3-940e-d165676150c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.716846 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-67c5cb2c-4865-45e3-940e-d165676150c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:38.717285 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-67c5cb2c-4865-45e3-940e-d165676150c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:38.834152 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-67c5cb2c-4865-45e3-940e-d165676150c3 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 14 microversion: 2.1 time: 0.132446 Dec 16 14:50:38.837265 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 527/1038] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:38 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:39.845269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-fb9b7db2-edd8-43e5-a218-e7ec895ba7cb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:39.846466 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-fb9b7db2-edd8-43e5-a218-e7ec895ba7cb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:39.854956 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb9b7db2-edd8-43e5-a218-e7ec895ba7cb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:39.855406 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb9b7db2-edd8-43e5-a218-e7ec895ba7cb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:39.856200 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb9b7db2-edd8-43e5-a218-e7ec895ba7cb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:39.856633 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-fb9b7db2-edd8-43e5-a218-e7ec895ba7cb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:39.973806 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-fb9b7db2-edd8-43e5-a218-e7ec895ba7cb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 14 microversion: 2.1 time: 0.132542 Dec 16 14:50:39.974414 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 512/1039] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:39 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:40.985694 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-7344c8a5-ebda-4191-8cde-d81efdfe04d4 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:40.986679 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-7344c8a5-ebda-4191-8cde-d81efdfe04d4 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:40.995065 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7344c8a5-ebda-4191-8cde-d81efdfe04d4 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:40.995546 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7344c8a5-ebda-4191-8cde-d81efdfe04d4 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:40.996306 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7344c8a5-ebda-4191-8cde-d81efdfe04d4 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:40.996733 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-7344c8a5-ebda-4191-8cde-d81efdfe04d4 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:41.115113 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-7344c8a5-ebda-4191-8cde-d81efdfe04d4 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 14 microversion: 2.1 time: 0.133297 Dec 16 14:50:41.115870 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 528/1040] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:40 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:42.127531 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-eb66c29e-95b6-4c21-a346-cbd76751b63e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:42.128445 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-eb66c29e-95b6-4c21-a346-cbd76751b63e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:42.137280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb66c29e-95b6-4c21-a346-cbd76751b63e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:42.137720 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb66c29e-95b6-4c21-a346-cbd76751b63e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:42.138480 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb66c29e-95b6-4c21-a346-cbd76751b63e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:42.138910 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-eb66c29e-95b6-4c21-a346-cbd76751b63e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:42.266524 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-eb66c29e-95b6-4c21-a346-cbd76751b63e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 14 microversion: 2.1 time: 0.143073 Dec 16 14:50:42.267136 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 513/1041] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:42 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:50:43.278151 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f8851c58-a798-475a-8eba-a371a2ff39f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:43.279140 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f8851c58-a798-475a-8eba-a371a2ff39f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:43.286964 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f8851c58-a798-475a-8eba-a371a2ff39f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:43.287415 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f8851c58-a798-475a-8eba-a371a2ff39f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:43.288180 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f8851c58-a798-475a-8eba-a371a2ff39f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:43.288613 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-f8851c58-a798-475a-8eba-a371a2ff39f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:43.416200 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f8851c58-a798-475a-8eba-a371a2ff39f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 4572 microversion: 2.1 time: 0.142061 Dec 16 14:50:43.416842 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 529/1042] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:43 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 4572 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:50:44.428157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7ca93d9f-113d-4d44-b821-5ef9315f226f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:44.429141 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7ca93d9f-113d-4d44-b821-5ef9315f226f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:44.437230 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7ca93d9f-113d-4d44-b821-5ef9315f226f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:44.437687 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7ca93d9f-113d-4d44-b821-5ef9315f226f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:44.438452 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7ca93d9f-113d-4d44-b821-5ef9315f226f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:44.438885 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7ca93d9f-113d-4d44-b821-5ef9315f226f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:44.562833 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7ca93d9f-113d-4d44-b821-5ef9315f226f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 15025 microversion: 2.1 time: 0.138888 Dec 16 14:50:44.563469 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 514/1043] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:44 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 15025 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:45.574856 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-868474c2-ce1c-41c2-a41e-ea4658436e22 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:45.575883 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-868474c2-ce1c-41c2-a41e-ea4658436e22 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:45.583698 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-868474c2-ce1c-41c2-a41e-ea4658436e22 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:45.584148 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-868474c2-ce1c-41c2-a41e-ea4658436e22 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:45.584944 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-868474c2-ce1c-41c2-a41e-ea4658436e22 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:45.585379 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-868474c2-ce1c-41c2-a41e-ea4658436e22 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:45.862458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-868474c2-ce1c-41c2-a41e-ea4658436e22 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 18449 microversion: 2.1 time: 0.291565 Dec 16 14:50:45.866033 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 530/1044] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:45 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 18449 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:46.874309 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-13913abb-6479-4c4c-bab0-d76d316ad2f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:46.875287 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-13913abb-6479-4c4c-bab0-d76d316ad2f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:46.883666 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13913abb-6479-4c4c-bab0-d76d316ad2f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:46.884109 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13913abb-6479-4c4c-bab0-d76d316ad2f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:46.884891 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13913abb-6479-4c4c-bab0-d76d316ad2f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:46.885319 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-13913abb-6479-4c4c-bab0-d76d316ad2f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:47.008673 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-13913abb-6479-4c4c-bab0-d76d316ad2f5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 20074 microversion: 2.1 time: 0.137657 Dec 16 14:50:47.009389 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 515/1045] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:46 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 20074 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:48.021474 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-18829cff-8ced-4e0c-86db-670ca2d903e9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:48.022496 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-18829cff-8ced-4e0c-86db-670ca2d903e9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:48.030272 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-18829cff-8ced-4e0c-86db-670ca2d903e9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:48.030724 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-18829cff-8ced-4e0c-86db-670ca2d903e9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:48.031786 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-18829cff-8ced-4e0c-86db-670ca2d903e9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:48.032227 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-18829cff-8ced-4e0c-86db-670ca2d903e9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:48.159646 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-18829cff-8ced-4e0c-86db-670ca2d903e9 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 22765 microversion: 2.1 time: 0.142066 Dec 16 14:50:48.160190 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 531/1046] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:48 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 22765 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:49.171642 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4710cc19-f1ab-4748-821f-45a3aea20128 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:49.172637 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-4710cc19-f1ab-4748-821f-45a3aea20128 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:49.181333 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4710cc19-f1ab-4748-821f-45a3aea20128 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:49.181784 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4710cc19-f1ab-4748-821f-45a3aea20128 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:49.182551 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4710cc19-f1ab-4748-821f-45a3aea20128 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:49.182985 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-4710cc19-f1ab-4748-821f-45a3aea20128 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:49.307259 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4710cc19-f1ab-4748-821f-45a3aea20128 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 23804 microversion: 2.1 time: 0.139446 Dec 16 14:50:49.307813 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 516/1047] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:49 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 23804 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:50.318447 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5791c40f-169d-44cd-b885-68da807a61aa tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:50.319448 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5791c40f-169d-44cd-b885-68da807a61aa tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:50.327881 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5791c40f-169d-44cd-b885-68da807a61aa tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:50.328333 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5791c40f-169d-44cd-b885-68da807a61aa tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:50.329206 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5791c40f-169d-44cd-b885-68da807a61aa tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:50.329642 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5791c40f-169d-44cd-b885-68da807a61aa tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:50.455747 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5791c40f-169d-44cd-b885-68da807a61aa tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 25528 microversion: 2.1 time: 0.141195 Dec 16 14:50:50.456424 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 532/1048] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:50 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 25528 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:51.467839 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-51fa1e5f-7d57-4247-be6a-d3ab1f9553be tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:51.468887 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-51fa1e5f-7d57-4247-be6a-d3ab1f9553be tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:51.476633 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-51fa1e5f-7d57-4247-be6a-d3ab1f9553be tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:51.477104 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-51fa1e5f-7d57-4247-be6a-d3ab1f9553be tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:51.477858 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-51fa1e5f-7d57-4247-be6a-d3ab1f9553be tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:51.478286 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-51fa1e5f-7d57-4247-be6a-d3ab1f9553be tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:51.611449 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-51fa1e5f-7d57-4247-be6a-d3ab1f9553be tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 26799 microversion: 2.1 time: 0.147576 Dec 16 14:50:51.612082 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 517/1049] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:51 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 26799 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:52.623484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-e6342060-3754-41b7-920b-cd7bfcfe2096 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:52.624497 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-e6342060-3754-41b7-920b-cd7bfcfe2096 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:52.632336 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6342060-3754-41b7-920b-cd7bfcfe2096 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:52.632801 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6342060-3754-41b7-920b-cd7bfcfe2096 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:52.634129 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6342060-3754-41b7-920b-cd7bfcfe2096 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:52.634555 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-e6342060-3754-41b7-920b-cd7bfcfe2096 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:52.760933 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-e6342060-3754-41b7-920b-cd7bfcfe2096 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 27692 microversion: 2.1 time: 0.141291 Dec 16 14:50:52.761562 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 533/1050] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:52 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 27692 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:53.773358 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-be25b4bb-6df6-431c-99c3-bdd0a163a7c5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:53.774339 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-be25b4bb-6df6-431c-99c3-bdd0a163a7c5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:53.782078 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be25b4bb-6df6-431c-99c3-bdd0a163a7c5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:53.782515 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be25b4bb-6df6-431c-99c3-bdd0a163a7c5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:53.783775 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be25b4bb-6df6-431c-99c3-bdd0a163a7c5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:53.783775 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-be25b4bb-6df6-431c-99c3-bdd0a163a7c5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:53.911815 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-be25b4bb-6df6-431c-99c3-bdd0a163a7c5 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 28172 microversion: 2.1 time: 0.142392 Dec 16 14:50:53.912714 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 518/1051] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:53 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 28172 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:54.923911 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ae691757-9082-4ea0-a83c-e44a8b4097b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:54.924925 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ae691757-9082-4ea0-a83c-e44a8b4097b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:54.933622 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ae691757-9082-4ea0-a83c-e44a8b4097b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:54.934061 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ae691757-9082-4ea0-a83c-e44a8b4097b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:54.934813 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ae691757-9082-4ea0-a83c-e44a8b4097b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:54.935235 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ae691757-9082-4ea0-a83c-e44a8b4097b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:55.049687 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ae691757-9082-4ea0-a83c-e44a8b4097b6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 28172 microversion: 2.1 time: 0.129681 Dec 16 14:50:55.050323 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 534/1052] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:54 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 28172 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:56.061733 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8424cef4-ea19-40e3-b940-8209c0c96593 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:56.062660 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8424cef4-ea19-40e3-b940-8209c0c96593 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:56.071874 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8424cef4-ea19-40e3-b940-8209c0c96593 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:56.071874 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8424cef4-ea19-40e3-b940-8209c0c96593 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:56.072590 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8424cef4-ea19-40e3-b940-8209c0c96593 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:56.073112 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8424cef4-ea19-40e3-b940-8209c0c96593 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:56.200429 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8424cef4-ea19-40e3-b940-8209c0c96593 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 28463 microversion: 2.1 time: 0.142688 Dec 16 14:50:56.201092 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 519/1053] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:56 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 28463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:57.213146 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9c3e6c0b-deea-4df2-905f-08e998817eaf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:57.214131 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9c3e6c0b-deea-4df2-905f-08e998817eaf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:57.222229 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9c3e6c0b-deea-4df2-905f-08e998817eaf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:57.222675 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9c3e6c0b-deea-4df2-905f-08e998817eaf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:57.223426 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9c3e6c0b-deea-4df2-905f-08e998817eaf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:57.223854 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9c3e6c0b-deea-4df2-905f-08e998817eaf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:57.348262 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9c3e6c0b-deea-4df2-905f-08e998817eaf tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 28631 microversion: 2.1 time: 0.139666 Dec 16 14:50:57.348949 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 535/1054] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:57 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 28631 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:58.360478 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-94d29ba6-72ea-4803-b3a6-cf0dff3dbf0b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:58.361509 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-94d29ba6-72ea-4803-b3a6-cf0dff3dbf0b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:58.369366 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-94d29ba6-72ea-4803-b3a6-cf0dff3dbf0b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:58.369810 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-94d29ba6-72ea-4803-b3a6-cf0dff3dbf0b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:58.370572 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-94d29ba6-72ea-4803-b3a6-cf0dff3dbf0b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:58.371006 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-94d29ba6-72ea-4803-b3a6-cf0dff3dbf0b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:58.492530 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-94d29ba6-72ea-4803-b3a6-cf0dff3dbf0b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 28631 microversion: 2.1 time: 0.135890 Dec 16 14:50:58.493200 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 520/1055] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:58 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 28631 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:50:59.504664 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2e48617e-e6e0-40a9-9d09-a839559a6b43 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:50:59.505677 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2e48617e-e6e0-40a9-9d09-a839559a6b43 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:50:59.514082 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2e48617e-e6e0-40a9-9d09-a839559a6b43 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:59.514529 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2e48617e-e6e0-40a9-9d09-a839559a6b43 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:59.515287 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2e48617e-e6e0-40a9-9d09-a839559a6b43 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:50:59.515719 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2e48617e-e6e0-40a9-9d09-a839559a6b43 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:50:59.632360 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2e48617e-e6e0-40a9-9d09-a839559a6b43 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 28631 microversion: 2.1 time: 0.131672 Dec 16 14:50:59.633019 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 536/1056] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:50:59 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 28631 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:51:00.644473 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-61d71f94-b5bc-4433-bdf6-65c03a172d63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:00.645492 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-61d71f94-b5bc-4433-bdf6-65c03a172d63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:00.653877 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61d71f94-b5bc-4433-bdf6-65c03a172d63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:00.654322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61d71f94-b5bc-4433-bdf6-65c03a172d63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:00.655091 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61d71f94-b5bc-4433-bdf6-65c03a172d63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:00.655515 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-61d71f94-b5bc-4433-bdf6-65c03a172d63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:00.778657 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-61d71f94-b5bc-4433-bdf6-65c03a172d63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 29305 microversion: 2.1 time: 0.138104 Dec 16 14:51:00.779296 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 521/1057] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:00 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 29305 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:51:01.795280 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-25658246-5910-4a5c-93d7-3ea238d154a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:01.796271 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-25658246-5910-4a5c-93d7-3ea238d154a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:01.804365 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-25658246-5910-4a5c-93d7-3ea238d154a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:01.804840 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-25658246-5910-4a5c-93d7-3ea238d154a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:01.806189 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-25658246-5910-4a5c-93d7-3ea238d154a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:01.806623 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-25658246-5910-4a5c-93d7-3ea238d154a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:01.928680 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-25658246-5910-4a5c-93d7-3ea238d154a6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 31588 microversion: 2.1 time: 0.138814 Dec 16 14:51:01.929335 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 537/1058] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:01 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 31588 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:51:02.715137 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:51:02.715742 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: Thu Dec 16 14:51:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 14:51:02.940947 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a435526d-90d9-4d3b-9717-6522f6b38d4b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:02.941935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a435526d-90d9-4d3b-9717-6522f6b38d4b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:02.950836 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a435526d-90d9-4d3b-9717-6522f6b38d4b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:02.951280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a435526d-90d9-4d3b-9717-6522f6b38d4b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:02.952039 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a435526d-90d9-4d3b-9717-6522f6b38d4b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:02.952465 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a435526d-90d9-4d3b-9717-6522f6b38d4b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:03.073257 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a435526d-90d9-4d3b-9717-6522f6b38d4b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 33116 microversion: 2.1 time: 0.136113 Dec 16 14:51:03.073789 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 522/1059] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:02 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 33116 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:51:04.084914 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0ed356de-20c0-4851-9d19-711d3f2a0f42 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:04.085828 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0ed356de-20c0-4851-9d19-711d3f2a0f42 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:04.094981 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0ed356de-20c0-4851-9d19-711d3f2a0f42 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:04.095431 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0ed356de-20c0-4851-9d19-711d3f2a0f42 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:04.096203 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0ed356de-20c0-4851-9d19-711d3f2a0f42 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:04.096632 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0ed356de-20c0-4851-9d19-711d3f2a0f42 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:04.220478 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0ed356de-20c0-4851-9d19-711d3f2a0f42 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 34173 microversion: 2.1 time: 0.139560 Dec 16 14:51:04.221184 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 538/1060] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:04 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 34173 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:51:05.234364 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-105cece7-8082-44ca-a460-76b9ab0aa5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:05.235363 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-105cece7-8082-44ca-a460-76b9ab0aa5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:05.243259 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-105cece7-8082-44ca-a460-76b9ab0aa5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:05.243706 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-105cece7-8082-44ca-a460-76b9ab0aa5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:05.244469 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-105cece7-8082-44ca-a460-76b9ab0aa5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:05.244921 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-105cece7-8082-44ca-a460-76b9ab0aa5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:05.367987 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-105cece7-8082-44ca-a460-76b9ab0aa5de tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 35632 microversion: 2.1 time: 0.138024 Dec 16 14:51:05.368622 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 523/1061] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:05 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 35632 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:51:06.381603 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0e5f36b8-fce1-40e5-8a89-fcbfacf0352e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:06.384149 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0e5f36b8-fce1-40e5-8a89-fcbfacf0352e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:06.392366 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0e5f36b8-fce1-40e5-8a89-fcbfacf0352e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:06.393356 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0e5f36b8-fce1-40e5-8a89-fcbfacf0352e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:06.394129 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0e5f36b8-fce1-40e5-8a89-fcbfacf0352e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:06.394556 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0e5f36b8-fce1-40e5-8a89-fcbfacf0352e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:06.522540 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0e5f36b8-fce1-40e5-8a89-fcbfacf0352e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 37416 microversion: 2.1 time: 0.146031 Dec 16 14:51:06.523190 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 539/1062] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:06 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 37416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:51:07.535957 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e97e1dc4-b4a8-4dc4-9974-585d312c9643 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:07.537054 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e97e1dc4-b4a8-4dc4-9974-585d312c9643 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:07.545946 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e97e1dc4-b4a8-4dc4-9974-585d312c9643 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:07.546513 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e97e1dc4-b4a8-4dc4-9974-585d312c9643 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:07.547305 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e97e1dc4-b4a8-4dc4-9974-585d312c9643 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:07.547743 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e97e1dc4-b4a8-4dc4-9974-585d312c9643 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:07.674230 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e97e1dc4-b4a8-4dc4-9974-585d312c9643 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 38166 microversion: 2.1 time: 0.142228 Dec 16 14:51:07.674907 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 524/1063] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:07 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 38166 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:51:08.687350 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-dd3d73c3-57fe-46d5-ae22-31adfd152c63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:08.688386 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-dd3d73c3-57fe-46d5-ae22-31adfd152c63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:08.696357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd3d73c3-57fe-46d5-ae22-31adfd152c63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:08.696835 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd3d73c3-57fe-46d5-ae22-31adfd152c63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:08.697624 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd3d73c3-57fe-46d5-ae22-31adfd152c63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:08.698057 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-dd3d73c3-57fe-46d5-ae22-31adfd152c63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:08.822964 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-dd3d73c3-57fe-46d5-ae22-31adfd152c63 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 38166 microversion: 2.1 time: 0.139568 Dec 16 14:51:08.827538 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 540/1064] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:08 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 38166 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:51:09.836385 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9b70ce39-cae5-46de-9f70-0bfceca5ad0d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:09.838010 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9b70ce39-cae5-46de-9f70-0bfceca5ad0d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:09.846844 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9b70ce39-cae5-46de-9f70-0bfceca5ad0d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:09.847299 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9b70ce39-cae5-46de-9f70-0bfceca5ad0d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:09.848099 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9b70ce39-cae5-46de-9f70-0bfceca5ad0d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:09.848543 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9b70ce39-cae5-46de-9f70-0bfceca5ad0d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:09.970637 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9b70ce39-cae5-46de-9f70-0bfceca5ad0d tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 38166 microversion: 2.1 time: 0.138456 Dec 16 14:51:09.971598 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 525/1065] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:09 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 38166 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:51:10.984436 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a74473bd-5d83-4132-87c8-574f3c9ada60 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:10.985462 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a74473bd-5d83-4132-87c8-574f3c9ada60 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:10.993615 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a74473bd-5d83-4132-87c8-574f3c9ada60 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:10.994058 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a74473bd-5d83-4132-87c8-574f3c9ada60 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:10.994826 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a74473bd-5d83-4132-87c8-574f3c9ada60 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:10.995252 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a74473bd-5d83-4132-87c8-574f3c9ada60 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:11.124951 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a74473bd-5d83-4132-87c8-574f3c9ada60 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 38176 microversion: 2.1 time: 0.144381 Dec 16 14:51:11.125657 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 541/1066] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:10 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 38176 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:51:12.137637 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-efdeb383-df1a-4697-b93a-04f72f2926a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:12.138549 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-efdeb383-df1a-4697-b93a-04f72f2926a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:12.146691 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-efdeb383-df1a-4697-b93a-04f72f2926a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:12.147144 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-efdeb383-df1a-4697-b93a-04f72f2926a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:12.147906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-efdeb383-df1a-4697-b93a-04f72f2926a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:12.148341 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-efdeb383-df1a-4697-b93a-04f72f2926a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:12.270792 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-efdeb383-df1a-4697-b93a-04f72f2926a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action" status: 200 len: 38297 microversion: 2.1 time: 0.137147 Dec 16 14:51:12.271476 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 526/1067] 10.222.0.64 () {60 vars in 1277 bytes} [Thu Dec 16 14:51:12 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/action => generated 38297 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:51:12.281649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c6566a89-f035-4a69-a856-009b2146a89f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:12.282218 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c6566a89-f035-4a69-a856-009b2146a89f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:12.290584 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c6566a89-f035-4a69-a856-009b2146a89f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:12.291028 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c6566a89-f035-4a69-a856-009b2146a89f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:12.291794 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c6566a89-f035-4a69-a856-009b2146a89f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:12.292227 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c6566a89-f035-4a69-a856-009b2146a89f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:12.349444 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c6566a89-f035-4a69-a856-009b2146a89f tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/ips" status: 200 len: 147 microversion: 2.1 time: 0.071766 Dec 16 14:51:12.350021 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 542/1068] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Dec 16 14:51:12 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/ips => generated 147 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:13.838708 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-94cf110f-fb52-4ee7-964a-2c190a529b2b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18602b05-20d8-4f41-801e-569ee40422b7"}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:13.839855 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-94cf110f-fb52-4ee7-964a-2c190a529b2b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:13.849041 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-94cf110f-fb52-4ee7-964a-2c190a529b2b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:13.849550 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-94cf110f-fb52-4ee7-964a-2c190a529b2b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:13.850407 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-94cf110f-fb52-4ee7-964a-2c190a529b2b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:13.851937 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-94cf110f-fb52-4ee7-964a-2c190a529b2b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:14.238538 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-94cf110f-fb52-4ee7-964a-2c190a529b2b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403916 Dec 16 14:51:14.239205 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 527/1069] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:51:13 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:21.111971 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-37d0f792-bf1b-4782-aad6-df0bdaf406a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:21.112919 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-37d0f792-bf1b-4782-aad6-df0bdaf406a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:21.121248 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37d0f792-bf1b-4782-aad6-df0bdaf406a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:21.121700 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37d0f792-bf1b-4782-aad6-df0bdaf406a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:21.122501 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37d0f792-bf1b-4782-aad6-df0bdaf406a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:21.122941 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-37d0f792-bf1b-4782-aad6-df0bdaf406a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:21.191182 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-37d0f792-bf1b-4782-aad6-df0bdaf406a0 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083055 Dec 16 14:51:21.191786 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 543/1070] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:51:21 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:21.203670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-55746b18-7718-416e-bdff-0dcfcf6697eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:21.204283 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-55746b18-7718-416e-bdff-0dcfcf6697eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:21.213643 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-55746b18-7718-416e-bdff-0dcfcf6697eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:21.214095 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-55746b18-7718-416e-bdff-0dcfcf6697eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:21.214880 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-55746b18-7718-416e-bdff-0dcfcf6697eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:21.215319 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-55746b18-7718-416e-bdff-0dcfcf6697eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:21.283076 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-55746b18-7718-416e-bdff-0dcfcf6697eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments/18602b05-20d8-4f41-801e-569ee40422b7" status: 200 len: 194 microversion: 2.1 time: 0.084467 Dec 16 14:51:21.283700 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 528/1071] 10.222.0.64 () {58 vars in 1412 bytes} [Thu Dec 16 14:51:21 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments/18602b05-20d8-4f41-801e-569ee40422b7 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:22.822307 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-99c37291-5168-4611-8087-bb869a6564eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09089fed-dac5-4a88-94d1-63f939f1450a"}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:22.823366 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-99c37291-5168-4611-8087-bb869a6564eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:22.831405 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-99c37291-5168-4611-8087-bb869a6564eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:22.831855 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-99c37291-5168-4611-8087-bb869a6564eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:22.832650 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-99c37291-5168-4611-8087-bb869a6564eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:22.833116 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-99c37291-5168-4611-8087-bb869a6564eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:23.250438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-99c37291-5168-4611-8087-bb869a6564eb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431695 Dec 16 14:51:23.256064 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 544/1072] 10.222.0.64 () {60 vars in 1322 bytes} [Thu Dec 16 14:51:22 2021] POST /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:51:31.132613 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-69257ed9-9254-4141-a5ae-a0060dbc68bb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:31.133550 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-69257ed9-9254-4141-a5ae-a0060dbc68bb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:31.141258 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69257ed9-9254-4141-a5ae-a0060dbc68bb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:31.141708 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69257ed9-9254-4141-a5ae-a0060dbc68bb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:31.142472 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69257ed9-9254-4141-a5ae-a0060dbc68bb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:31.142903 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-69257ed9-9254-4141-a5ae-a0060dbc68bb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:31.210347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-69257ed9-9254-4141-a5ae-a0060dbc68bb tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.081525 Dec 16 14:51:31.210909 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 529/1073] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:51:31 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:31.399544 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-185e916d-a892-4973-ac81-603c1b9bc862 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:31.400104 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-185e916d-a892-4973-ac81-603c1b9bc862 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:31.411935 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-185e916d-a892-4973-ac81-603c1b9bc862 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:31.412374 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-185e916d-a892-4973-ac81-603c1b9bc862 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:31.413188 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-185e916d-a892-4973-ac81-603c1b9bc862 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:31.413620 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-185e916d-a892-4973-ac81-603c1b9bc862 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:31.478357 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-185e916d-a892-4973-ac81-603c1b9bc862 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments/18602b05-20d8-4f41-801e-569ee40422b7" status: 200 len: 194 microversion: 2.1 time: 0.083613 Dec 16 14:51:31.479595 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 545/1074] 10.222.0.64 () {58 vars in 1412 bytes} [Thu Dec 16 14:51:31 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments/18602b05-20d8-4f41-801e-569ee40422b7 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:31.489138 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c6d14bd8-78d2-4dec-a336-efaef1ef77a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:31.489633 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c6d14bd8-78d2-4dec-a336-efaef1ef77a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:31.497077 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6d14bd8-78d2-4dec-a336-efaef1ef77a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:31.497526 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6d14bd8-78d2-4dec-a336-efaef1ef77a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:31.498305 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6d14bd8-78d2-4dec-a336-efaef1ef77a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:31.498744 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c6d14bd8-78d2-4dec-a336-efaef1ef77a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:31.664502 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-c6d14bd8-78d2-4dec-a336-efaef1ef77a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lazy-loading 'services' on Instance uuid 4afe80a2-2118-448f-870e-b4b3798ca297 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:51:31.802356 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c6d14bd8-78d2-4dec-a336-efaef1ef77a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments/18602b05-20d8-4f41-801e-569ee40422b7" status: 202 len: 0 microversion: 2.1 time: 0.316839 Dec 16 14:51:31.802943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 530/1075] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:51:31 2021] DELETE /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments/18602b05-20d8-4f41-801e-569ee40422b7 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:51:34.123468 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0c2e2b2f-408e-4814-b222-3e4dc7126632 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:34.124063 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0c2e2b2f-408e-4814-b222-3e4dc7126632 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:34.131646 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0c2e2b2f-408e-4814-b222-3e4dc7126632 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:34.132095 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0c2e2b2f-408e-4814-b222-3e4dc7126632 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:34.132898 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0c2e2b2f-408e-4814-b222-3e4dc7126632 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:34.133332 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0c2e2b2f-408e-4814-b222-3e4dc7126632 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:34.200094 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0c2e2b2f-408e-4814-b222-3e4dc7126632 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments/09089fed-dac5-4a88-94d1-63f939f1450a" status: 200 len: 194 microversion: 2.1 time: 0.080964 Dec 16 14:51:34.200732 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 546/1076] 10.222.0.64 () {58 vars in 1412 bytes} [Thu Dec 16 14:51:34 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments/09089fed-dac5-4a88-94d1-63f939f1450a => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:34.211006 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-789b1d85-d8d8-487b-a6dd-477082822b87 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:34.211006 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-789b1d85-d8d8-487b-a6dd-477082822b87 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:34.219743 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-789b1d85-d8d8-487b-a6dd-477082822b87 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:34.220291 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-789b1d85-d8d8-487b-a6dd-477082822b87 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:34.221127 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-789b1d85-d8d8-487b-a6dd-477082822b87 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:34.221697 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-789b1d85-d8d8-487b-a6dd-477082822b87 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:34.384732 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-789b1d85-d8d8-487b-a6dd-477082822b87 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lazy-loading 'services' on Instance uuid 4afe80a2-2118-448f-870e-b4b3798ca297 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:51:34.525482 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-789b1d85-d8d8-487b-a6dd-477082822b87 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments/09089fed-dac5-4a88-94d1-63f939f1450a" status: 202 len: 0 microversion: 2.1 time: 0.318391 Dec 16 14:51:34.526106 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 531/1077] 10.222.0.64 () {58 vars in 1415 bytes} [Thu Dec 16 14:51:34 2021] DELETE /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments/09089fed-dac5-4a88-94d1-63f939f1450a => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:51:35.812114 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4231530b-0e39-46e1-a9d2-676e9721d5c6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:35.813101 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4231530b-0e39-46e1-a9d2-676e9721d5c6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:35.820473 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4231530b-0e39-46e1-a9d2-676e9721d5c6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:35.820976 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4231530b-0e39-46e1-a9d2-676e9721d5c6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:35.821738 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4231530b-0e39-46e1-a9d2-676e9721d5c6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:35.822207 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4231530b-0e39-46e1-a9d2-676e9721d5c6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:35.884522 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4231530b-0e39-46e1-a9d2-676e9721d5c6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076600 Dec 16 14:51:35.885105 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 547/1078] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:51:35 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:51:36.075156 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-43ebbcc1-4ae1-4627-b41d-04acf5eb288e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:36.076156 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-43ebbcc1-4ae1-4627-b41d-04acf5eb288e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:36.083657 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43ebbcc1-4ae1-4627-b41d-04acf5eb288e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:36.084103 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43ebbcc1-4ae1-4627-b41d-04acf5eb288e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:36.084904 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43ebbcc1-4ae1-4627-b41d-04acf5eb288e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:36.085341 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-43ebbcc1-4ae1-4627-b41d-04acf5eb288e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:36.148463 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-43ebbcc1-4ae1-4627-b41d-04acf5eb288e tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078086 Dec 16 14:51:36.149800 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 532/1079] 10.222.0.64 () {58 vars in 1301 bytes} [Thu Dec 16 14:51:36 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:51:36.247185 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b178a33f-0c28-47ce-9f6c-b8ea6f78e48b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:36.247677 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b178a33f-0c28-47ce-9f6c-b8ea6f78e48b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:36.254967 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b178a33f-0c28-47ce-9f6c-b8ea6f78e48b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:36.255412 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b178a33f-0c28-47ce-9f6c-b8ea6f78e48b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:36.256186 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b178a33f-0c28-47ce-9f6c-b8ea6f78e48b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:36.256619 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b178a33f-0c28-47ce-9f6c-b8ea6f78e48b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:36.319232 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b178a33f-0c28-47ce-9f6c-b8ea6f78e48b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Going to try to terminate instance {{(pid=101914) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:51:36.432011 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b178a33f-0c28-47ce-9f6c-b8ea6f78e48b tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 204 len: 0 microversion: 2.1 time: 0.188505 Dec 16 14:51:36.432856 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 548/1080] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:51:36 2021] DELETE /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:51:36.440788 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a6a1852d-799a-4061-929a-a2a9d29ffb2a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:36.441404 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a6a1852d-799a-4061-929a-a2a9d29ffb2a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:36.448775 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a6a1852d-799a-4061-929a-a2a9d29ffb2a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:36.449303 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a6a1852d-799a-4061-929a-a2a9d29ffb2a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:36.450059 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a6a1852d-799a-4061-929a-a2a9d29ffb2a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:36.450483 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a6a1852d-799a-4061-929a-a2a9d29ffb2a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:36.654220 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-a6a1852d-799a-4061-929a-a2a9d29ffb2a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:51:36.662292 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a6a1852d-799a-4061-929a-a2a9d29ffb2a tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1675 microversion: 2.1 time: 0.225401 Dec 16 14:51:36.662859 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 533/1081] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:36 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:37.684964 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3a12d5fa-7fbf-449f-8a49-dd44a289a3a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:37.686241 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3a12d5fa-7fbf-449f-8a49-dd44a289a3a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:37.698256 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3a12d5fa-7fbf-449f-8a49-dd44a289a3a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:37.698700 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3a12d5fa-7fbf-449f-8a49-dd44a289a3a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:37.699484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3a12d5fa-7fbf-449f-8a49-dd44a289a3a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:37.699918 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3a12d5fa-7fbf-449f-8a49-dd44a289a3a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:37.902980 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-3a12d5fa-7fbf-449f-8a49-dd44a289a3a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:51:37.912438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3a12d5fa-7fbf-449f-8a49-dd44a289a3a7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1675 microversion: 2.1 time: 0.235816 Dec 16 14:51:37.913056 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 549/1082] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:37 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:38.930548 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0f937dac-0e5f-4195-a6cf-a00810dc6b73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:38.931157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0f937dac-0e5f-4195-a6cf-a00810dc6b73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:38.938943 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f937dac-0e5f-4195-a6cf-a00810dc6b73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:38.939393 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f937dac-0e5f-4195-a6cf-a00810dc6b73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:38.940160 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f937dac-0e5f-4195-a6cf-a00810dc6b73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:38.940597 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0f937dac-0e5f-4195-a6cf-a00810dc6b73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:39.283576 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-0f937dac-0e5f-4195-a6cf-a00810dc6b73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:51:39.293275 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0f937dac-0e5f-4195-a6cf-a00810dc6b73 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1675 microversion: 2.1 time: 0.365734 Dec 16 14:51:39.293476 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 534/1083] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:38 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1675 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:39.917906 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-6970a4f8-a445-490f-9b6f-430b5838b08e req-051ca431-9341-4f08-86e6-38719f68ef71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afe80a2-2118-448f-870e-b4b3798ca297", "name": "network-vif-deleted", "tag": "d43ffe48-4dfa-4c03-80bb-fc3cbc8fc888"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:39.919838 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:51:39.919838 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:51:39.930594 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-6970a4f8-a445-490f-9b6f-430b5838b08e req-051ca431-9341-4f08-86e6-38719f68ef71 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:39.931041 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-6970a4f8-a445-490f-9b6f-430b5838b08e req-051ca431-9341-4f08-86e6-38719f68ef71 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:39.948973 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-6970a4f8-a445-490f-9b6f-430b5838b08e req-051ca431-9341-4f08-86e6-38719f68ef71 service nova] Creating event network-vif-deleted:d43ffe48-4dfa-4c03-80bb-fc3cbc8fc888 for instance 4afe80a2-2118-448f-870e-b4b3798ca297 on hv-cinder-82189 Dec 16 14:51:39.954731 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-6970a4f8-a445-490f-9b6f-430b5838b08e req-051ca431-9341-4f08-86e6-38719f68ef71 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041082 Dec 16 14:51:39.955612 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 550/1084] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:51:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:51:40.309942 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:40.310559 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:40.318215 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:40.318667 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:40.319517 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:40.319958 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:40.389402 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:40.389853 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:40.390304 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lazy-loading 'fault' on Instance uuid 4afe80a2-2118-448f-870e-b4b3798ca297 {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:51:40.468504 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48319d5dcda64acebea9bb3daad1889b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0a577a94a04b3eaaaf2d2347f21e44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:51:40.478219 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b4505eed-320c-4003-880b-fc3d7e131837 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 200 len: 1328 microversion: 2.1 time: 0.171953 Dec 16 14:51:40.478800 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 535/1085] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:40 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 1328 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:51:41.496022 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0dd8fad0-22dd-4cd7-89af-0f8e4873ca45 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:41.496624 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0dd8fad0-22dd-4cd7-89af-0f8e4873ca45 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:41.504060 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0dd8fad0-22dd-4cd7-89af-0f8e4873ca45 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:41.504503 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0dd8fad0-22dd-4cd7-89af-0f8e4873ca45 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:41.505311 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0dd8fad0-22dd-4cd7-89af-0f8e4873ca45 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:41.505743 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0dd8fad0-22dd-4cd7-89af-0f8e4873ca45 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:41.557794 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-0dd8fad0-22dd-4cd7-89af-0f8e4873ca45 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] HTTP exception thrown: Instance 4afe80a2-2118-448f-870e-b4b3798ca297 could not be found. Dec 16 14:51:41.558394 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0dd8fad0-22dd-4cd7-89af-0f8e4873ca45 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Returning 404 to user: Instance 4afe80a2-2118-448f-870e-b4b3798ca297 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:41.559248 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0dd8fad0-22dd-4cd7-89af-0f8e4873ca45 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 404 len: 111 microversion: 2.1 time: 0.067466 Dec 16 14:51:41.559765 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 551/1086] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:41 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:51:41.568856 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b8103d2c-09d1-43f5-b252-6ea8f8295205 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '.version_select at 0x7f3c2ce904c0>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:41.587865 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b8103d2c-09d1-43f5-b252-6ea8f8295205 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497082308" status: 202 len: 0 microversion: 2.1 time: 0.023319 Dec 16 14:51:41.588469 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 536/1087] 10.222.0.64 () {58 vars in 1220 bytes} [Thu Dec 16 14:51:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497082308 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:51:45.038874 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-97dd503b-530a-4c99-a34f-cbd5dbd2dad7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:45.039377 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-97dd503b-530a-4c99-a34f-cbd5dbd2dad7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:45.046699 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-97dd503b-530a-4c99-a34f-cbd5dbd2dad7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:45.047138 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-97dd503b-530a-4c99-a34f-cbd5dbd2dad7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:45.047920 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-97dd503b-530a-4c99-a34f-cbd5dbd2dad7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:45.048345 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-97dd503b-530a-4c99-a34f-cbd5dbd2dad7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:45.098110 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-97dd503b-530a-4c99-a34f-cbd5dbd2dad7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] HTTP exception thrown: Instance 4afe80a2-2118-448f-870e-b4b3798ca297 could not be found. Dec 16 14:51:45.098748 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-97dd503b-530a-4c99-a34f-cbd5dbd2dad7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Returning 404 to user: Instance 4afe80a2-2118-448f-870e-b4b3798ca297 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:45.099565 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-97dd503b-530a-4c99-a34f-cbd5dbd2dad7 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 404 len: 111 microversion: 2.1 time: 0.064602 Dec 16 14:51:45.100107 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 552/1088] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:51:45 2021] DELETE /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:51:45.108382 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9396eedf-1a39-4736-b566-4d17d958b599 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:45.109037 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-9396eedf-1a39-4736-b566-4d17d958b599 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: 4afe80a2-2118-448f-870e-b4b3798ca297] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:45.116298 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9396eedf-1a39-4736-b566-4d17d958b599 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:45.116745 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9396eedf-1a39-4736-b566-4d17d958b599 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:45.117536 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9396eedf-1a39-4736-b566-4d17d958b599 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:45.117970 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-9396eedf-1a39-4736-b566-4d17d958b599 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:45.167891 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-9396eedf-1a39-4736-b566-4d17d958b599 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] HTTP exception thrown: Instance 4afe80a2-2118-448f-870e-b4b3798ca297 could not be found. Dec 16 14:51:45.168384 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-9396eedf-1a39-4736-b566-4d17d958b599 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Returning 404 to user: Instance 4afe80a2-2118-448f-870e-b4b3798ca297 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:45.169235 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-9396eedf-1a39-4736-b566-4d17d958b599 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297" status: 404 len: 111 microversion: 2.1 time: 0.065078 Dec 16 14:51:45.169786 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 537/1089] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:45 2021] GET /compute/v2.1/servers/4afe80a2-2118-448f-870e-b4b3798ca297 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:51:46.409661 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2cfe755c-b209-4e86-8072-b8d5f5036ed6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:46.410142 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2cfe755c-b209-4e86-8072-b8d5f5036ed6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:46.417394 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2cfe755c-b209-4e86-8072-b8d5f5036ed6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:46.418500 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2cfe755c-b209-4e86-8072-b8d5f5036ed6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:46.419265 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2cfe755c-b209-4e86-8072-b8d5f5036ed6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:46.419693 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2cfe755c-b209-4e86-8072-b8d5f5036ed6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:46.468437 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-2cfe755c-b209-4e86-8072-b8d5f5036ed6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] HTTP exception thrown: Instance e21eb2e8-5685-4000-b8c6-edb7fb5daa68 could not be found. Dec 16 14:51:46.469064 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2cfe755c-b209-4e86-8072-b8d5f5036ed6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Returning 404 to user: Instance e21eb2e8-5685-4000-b8c6-edb7fb5daa68 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:46.469878 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2cfe755c-b209-4e86-8072-b8d5f5036ed6 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 404 len: 111 microversion: 2.1 time: 0.063942 Dec 16 14:51:46.470423 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 553/1090] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:51:46 2021] DELETE /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:51:46.478121 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-03bcf5ae-00ea-438d-a3cb-eb385acfde30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:46.478726 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-03bcf5ae-00ea-438d-a3cb-eb385acfde30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] [instance: e21eb2e8-5685-4000-b8c6-edb7fb5daa68] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:51:46.486901 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-03bcf5ae-00ea-438d-a3cb-eb385acfde30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:46.487561 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-03bcf5ae-00ea-438d-a3cb-eb385acfde30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:46.488347 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-03bcf5ae-00ea-438d-a3cb-eb385acfde30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:51:46.488879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-03bcf5ae-00ea-438d-a3cb-eb385acfde30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:51:46.537531 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-03bcf5ae-00ea-438d-a3cb-eb385acfde30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] HTTP exception thrown: Instance e21eb2e8-5685-4000-b8c6-edb7fb5daa68 could not be found. Dec 16 14:51:46.538137 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-03bcf5ae-00ea-438d-a3cb-eb385acfde30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] Returning 404 to user: Instance e21eb2e8-5685-4000-b8c6-edb7fb5daa68 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:46.538949 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-03bcf5ae-00ea-438d-a3cb-eb385acfde30 tempest-AttachVolumeTestJSON-227359587 tempest-AttachVolumeTestJSON-227359587-project] 10.222.0.64 "GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68" status: 404 len: 111 microversion: 2.1 time: 0.064557 Dec 16 14:51:46.539489 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 538/1091] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:51:46 2021] GET /compute/v2.1/servers/e21eb2e8-5685-4000-b8c6-edb7fb5daa68 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:51:53.057659 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5af202d1-589a-4e29-9438-d8ddd73d455a tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Action: 'create', calling method: .version_select at 0x7f3c2c5d83a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-251556780", "metadata": {"Type": "work"}}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:53.059114 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5af202d1-589a-4e29-9438-d8ddd73d455a tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:53.059892 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5af202d1-589a-4e29-9438-d8ddd73d455a tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134964 Dec 16 14:51:53.060438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 554/1092] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Dec 16 14:51:52 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:51:53.069272 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-172cb1c8-1e84-4b6c-be4b-0bc21903e859 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Action: 'create', calling method: .version_select at 0x7f3c2cdcf9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1438519994", "metadata": {"Type": "work"}}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:53.070650 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-172cb1c8-1e84-4b6c-be4b-0bc21903e859 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:53.071422 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-172cb1c8-1e84-4b6c-be4b-0bc21903e859 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005867 Dec 16 14:51:53.071926 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 539/1093] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Dec 16 14:51:53 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:51:53.080125 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-69361080-ca68-48ed-8439-da6b75f3a782 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Action: 'create', calling method: .version_select at 0x7f3c2d8768b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1708354754", "metadata": {"Type": "work"}}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:51:53.081980 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-69361080-ca68-48ed-8439-da6b75f3a782 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:53.082798 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-69361080-ca68-48ed-8439-da6b75f3a782 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006277 Dec 16 14:51:53.083670 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 555/1094] 10.222.0.64 () {60 vars in 1155 bytes} [Thu Dec 16 14:51:53 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:51:53.091935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a99efc07-b7bb-4c4a-985c-07c0ff40ad7c tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Calling method '.version_select at 0x7f3c2d7cd8b0>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:53.154326 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-a99efc07-b7bb-4c4a-985c-07c0ff40ad7c tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] HTTP exception thrown: Volume tempest-invalid-1629074351 could not be found. Dec 16 14:51:53.154922 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a99efc07-b7bb-4c4a-985c-07c0ff40ad7c tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Returning 404 to user: Volume tempest-invalid-1629074351 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:53.155734 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a99efc07-b7bb-4c4a-985c-07c0ff40ad7c tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1629074351" status: 404 len: 99 microversion: 2.1 time: 0.067860 Dec 16 14:51:53.156270 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 540/1095] 10.222.0.64 () {58 vars in 1217 bytes} [Thu Dec 16 14:51:53 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1629074351 => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 16 14:51:53.165116 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1ff5734a-e7a7-4519-b26e-9a5e93330a9b tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003543 Dec 16 14:51:53.165597 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 556/1096] 10.222.0.64 () {58 vars in 1139 bytes} [Thu Dec 16 14:51:53 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 16 14:51:53.173907 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-1625de61-a80f-4f5b-b161-735b1f860332 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003407 Dec 16 14:51:53.174396 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 541/1097] 10.222.0.64 () {58 vars in 1136 bytes} [Thu Dec 16 14:51:53 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 16 14:51:53.182711 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d0c3b42f-2cb9-4ed8-99e6-a31039c29b46 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Calling method '.version_select at 0x7f3c2c5d84c0>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:53.241898 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-d0c3b42f-2cb9-4ed8-99e6-a31039c29b46 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] HTTP exception thrown: Volume e3683d54-2c40-4d7f-9c76-6d0350a53813 could not be found. Dec 16 14:51:53.242496 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-d0c3b42f-2cb9-4ed8-99e6-a31039c29b46 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Returning 404 to user: Volume e3683d54-2c40-4d7f-9c76-6d0350a53813 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:53.243308 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-d0c3b42f-2cb9-4ed8-99e6-a31039c29b46 tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/e3683d54-2c40-4d7f-9c76-6d0350a53813" status: 404 len: 109 microversion: 2.1 time: 0.064341 Dec 16 14:51:53.243852 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 557/1098] 10.222.0.64 () {58 vars in 1247 bytes} [Thu Dec 16 14:51:53 2021] DELETE /compute/v2.1/os-volumes/e3683d54-2c40-4d7f-9c76-6d0350a53813 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:51:53.253706 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4720955b-7348-40da-bd34-21e40b3f48ad tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Calling method '.version_select at 0x7f3c2cd9be50>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:51:53.311740 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-4720955b-7348-40da-bd34-21e40b3f48ad tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] HTTP exception thrown: Volume 9a306f06-cc43-4eaf-ae4e-c609d9bf7bd5 could not be found. Dec 16 14:51:53.312475 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-4720955b-7348-40da-bd34-21e40b3f48ad tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] Returning 404 to user: Volume 9a306f06-cc43-4eaf-ae4e-c609d9bf7bd5 could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:51:53.313370 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-4720955b-7348-40da-bd34-21e40b3f48ad tempest-VolumesNegativeTest-1380066446 tempest-VolumesNegativeTest-1380066446-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/9a306f06-cc43-4eaf-ae4e-c609d9bf7bd5" status: 404 len: 109 microversion: 2.1 time: 0.063807 Dec 16 14:51:53.313901 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 542/1099] 10.222.0.64 () {58 vars in 1244 bytes} [Thu Dec 16 14:51:53 2021] GET /compute/v2.1/os-volumes/9a306f06-cc43-4eaf-ae4e-c609d9bf7bd5 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:52:13.874911 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-ba5f00e0-360c-4219-9bfe-38639fcb6f50 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:13.875484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ba5f00e0-360c-4219-9bfe-38639fcb6f50 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:13.883611 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ba5f00e0-360c-4219-9bfe-38639fcb6f50 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:13.884085 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ba5f00e0-360c-4219-9bfe-38639fcb6f50 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:13.884887 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ba5f00e0-360c-4219-9bfe-38639fcb6f50 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:13.885323 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-ba5f00e0-360c-4219-9bfe-38639fcb6f50 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:13.947383 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-ba5f00e0-360c-4219-9bfe-38639fcb6f50 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Going to try to terminate instance {{(pid=101914) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:52:14.056183 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-ba5f00e0-360c-4219-9bfe-38639fcb6f50 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 204 len: 0 microversion: 2.1 time: 0.185231 Dec 16 14:52:14.056758 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 558/1100] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:52:13 2021] DELETE /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:52:14.066229 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e1ecafdd-1ac4-4d15-b032-8a68e26aa89d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:14.066836 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e1ecafdd-1ac4-4d15-b032-8a68e26aa89d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:14.074209 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e1ecafdd-1ac4-4d15-b032-8a68e26aa89d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:14.074656 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e1ecafdd-1ac4-4d15-b032-8a68e26aa89d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:14.075452 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e1ecafdd-1ac4-4d15-b032-8a68e26aa89d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:14.075886 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e1ecafdd-1ac4-4d15-b032-8a68e26aa89d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:14.275485 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e1ecafdd-1ac4-4d15-b032-8a68e26aa89d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:14.284538 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e1ecafdd-1ac4-4d15-b032-8a68e26aa89d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1577 microversion: 2.1 time: 0.223285 Dec 16 14:52:14.291157 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 543/1101] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:14 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:15.301415 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1ecb14c8-109a-4d2f-aa61-a8b70e199995 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:15.302134 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1ecb14c8-109a-4d2f-aa61-a8b70e199995 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:15.310438 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1ecb14c8-109a-4d2f-aa61-a8b70e199995 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:15.310905 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1ecb14c8-109a-4d2f-aa61-a8b70e199995 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:15.311691 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1ecb14c8-109a-4d2f-aa61-a8b70e199995 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:15.312118 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1ecb14c8-109a-4d2f-aa61-a8b70e199995 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:15.501812 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1ecb14c8-109a-4d2f-aa61-a8b70e199995 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:15.509922 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1ecb14c8-109a-4d2f-aa61-a8b70e199995 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1577 microversion: 2.1 time: 0.212735 Dec 16 14:52:15.510505 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 559/1102] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:15 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:16.526883 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-671dff0b-daf2-4278-90d8-e117364b50c6 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:16.527518 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-671dff0b-daf2-4278-90d8-e117364b50c6 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:16.535456 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-671dff0b-daf2-4278-90d8-e117364b50c6 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:16.535978 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-671dff0b-daf2-4278-90d8-e117364b50c6 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:16.536964 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-671dff0b-daf2-4278-90d8-e117364b50c6 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:16.537467 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-671dff0b-daf2-4278-90d8-e117364b50c6 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:16.983277 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-671dff0b-daf2-4278-90d8-e117364b50c6 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:16.992421 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-671dff0b-daf2-4278-90d8-e117364b50c6 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1577 microversion: 2.1 time: 0.469393 Dec 16 14:52:16.993287 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 544/1103] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:16 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1577 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:17.313512 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-04b84359-75ca-4ab7-bdc9-f1f4c506a10c req-4bf81793-f4d3-43fe-8701-853c14051a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2349104f-921f-4317-8b04-be3a09d2b6aa", "name": "network-vif-deleted", "tag": "f680558f-d751-456d-a86d-c61c5e172d8d"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:52:17.316126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:52:17.316126 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:52:17.325948 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-04b84359-75ca-4ab7-bdc9-f1f4c506a10c req-4bf81793-f4d3-43fe-8701-853c14051a3a service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:17.326628 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-04b84359-75ca-4ab7-bdc9-f1f4c506a10c req-4bf81793-f4d3-43fe-8701-853c14051a3a service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:17.361200 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-04b84359-75ca-4ab7-bdc9-f1f4c506a10c req-4bf81793-f4d3-43fe-8701-853c14051a3a service nova] Creating event network-vif-deleted:f680558f-d751-456d-a86d-c61c5e172d8d for instance 2349104f-921f-4317-8b04-be3a09d2b6aa on hv-cinder-82189 Dec 16 14:52:17.366337 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-04b84359-75ca-4ab7-bdc9-f1f4c506a10c req-4bf81793-f4d3-43fe-8701-853c14051a3a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056408 Dec 16 14:52:17.367502 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 560/1104] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:52:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:52:18.008694 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:18.009516 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:18.017171 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:18.017616 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:18.018430 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:18.018857 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:18.091866 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:18.092316 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:18.092772 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lazy-loading 'fault' on Instance uuid 2349104f-921f-4317-8b04-be3a09d2b6aa {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:52:18.174368 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:18.182910 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-135e6ae8-5ce0-4243-9de1-6fbc9219c7f7 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 200 len: 1230 microversion: 2.1 time: 0.177971 Dec 16 14:52:18.193044 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 545/1105] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:18 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 1230 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:19.201218 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-76ee6b3f-7b1e-4b88-bf35-09f26e095865 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:19.201817 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-76ee6b3f-7b1e-4b88-bf35-09f26e095865 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:19.209361 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-76ee6b3f-7b1e-4b88-bf35-09f26e095865 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:19.209741 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-76ee6b3f-7b1e-4b88-bf35-09f26e095865 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:19.210508 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-76ee6b3f-7b1e-4b88-bf35-09f26e095865 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:19.210941 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-76ee6b3f-7b1e-4b88-bf35-09f26e095865 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:19.260019 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-76ee6b3f-7b1e-4b88-bf35-09f26e095865 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] HTTP exception thrown: Instance 2349104f-921f-4317-8b04-be3a09d2b6aa could not be found. Dec 16 14:52:19.260599 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-76ee6b3f-7b1e-4b88-bf35-09f26e095865 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Returning 404 to user: Instance 2349104f-921f-4317-8b04-be3a09d2b6aa could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:52:19.261474 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-76ee6b3f-7b1e-4b88-bf35-09f26e095865 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 404 len: 111 microversion: 2.1 time: 0.065353 Dec 16 14:52:19.262020 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 561/1106] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:19 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:52:19.373269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-441625563", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1174908289", "security_groups": [{"name": "tempest-secgroup-smoke-1001105392"}], "block_device_mapping_v2": [{"uuid": "437d500d-845b-439f-931a-ad5c08b7de1e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9786e867-a38a-4109-abba-499d29f3c81d"}]}} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:52:19.530054 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.network.neutron [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] validate_networks() for [('9786e867-a38a-4109-abba-499d29f3c81d', None, None, None)] {{(pid=101915) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:52:20.312169 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Flavor limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:52:20.312776 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Image limits 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:52:20.313768 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Flavor pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:52:20.314283 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Image pref 0:0:0 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:52:20.314946 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.virt.hardware [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:52:20.324043 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:20.324503 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:20.325841 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:20.326280 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:20.346128 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Getting quotas for project d963a0aa72964047885ee0212d5055dc. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:52:20.350842 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.quota [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Getting quotas for user ee703ae6a79f48cdb9438f504085e206 and project d963a0aa72964047885ee0212d5055dc. Resources: {'instances', 'cores', 'ram'} {{(pid=101915) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:52:20.454514 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Going to run 1 instances... {{(pid=101915) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:52:20.456798 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='437d500d-845b-439f-931a-ad5c08b7de1e',volume_size=None,volume_type=None)] {{(pid=101915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:52:20.640568 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c5c45550-f1e9-4066-993c-f68e6f778fa1 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.270931 Dec 16 14:52:20.641242 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 546/1107] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:52:19 2021] POST /compute/v2.1/servers => generated 406 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:52:20.651039 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-f6c73d4b-651c-4f57-a98c-6fc2305cf26f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:20.651613 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-f6c73d4b-651c-4f57-a98c-6fc2305cf26f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:20.722756 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-f6c73d4b-651c-4f57-a98c-6fc2305cf26f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:20.730312 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-f6c73d4b-651c-4f57-a98c-6fc2305cf26f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1094 microversion: 2.1 time: 0.082922 Dec 16 14:52:20.730890 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 562/1108] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:20 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:52:21.747084 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-c9853eaa-8395-49f9-a506-e782daaf98cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:21.747776 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-c9853eaa-8395-49f9-a506-e782daaf98cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:21.757071 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c9853eaa-8395-49f9-a506-e782daaf98cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:21.757703 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c9853eaa-8395-49f9-a506-e782daaf98cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:21.758437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c9853eaa-8395-49f9-a506-e782daaf98cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:21.758929 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-c9853eaa-8395-49f9-a506-e782daaf98cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:21.958670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-c9853eaa-8395-49f9-a506-e782daaf98cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:21.967358 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-c9853eaa-8395-49f9-a506-e782daaf98cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1200 microversion: 2.1 time: 0.224276 Dec 16 14:52:21.967923 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 547/1109] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:21 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1200 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:52:22.983845 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c1182cf5-ba25-45f9-9ca1-0c82997f62ed tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:22.984687 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c1182cf5-ba25-45f9-9ca1-0c82997f62ed tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:22.996750 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c1182cf5-ba25-45f9-9ca1-0c82997f62ed tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:22.997907 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c1182cf5-ba25-45f9-9ca1-0c82997f62ed tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:22.998839 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c1182cf5-ba25-45f9-9ca1-0c82997f62ed tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:22.999359 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c1182cf5-ba25-45f9-9ca1-0c82997f62ed tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:23.564695 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c1182cf5-ba25-45f9-9ca1-0c82997f62ed tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:23.574165 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c1182cf5-ba25-45f9-9ca1-0c82997f62ed tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.594552 Dec 16 14:52:23.574742 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 563/1110] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:22 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:24.029662 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-ca16ddc5-44f0-4055-95a8-9121ae14b34e req-7f53bf9e-3bd7-4290-a731-66fee014393f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde36abe-c87d-457c-b41a-040288d694da", "tag": "ebfe0ce8-aac6-476b-a756-32c12fac0eb3"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:52:24.031790 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:52:24.031790 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:52:24.040757 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-ca16ddc5-44f0-4055-95a8-9121ae14b34e req-7f53bf9e-3bd7-4290-a731-66fee014393f service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:24.041482 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-ca16ddc5-44f0-4055-95a8-9121ae14b34e req-7f53bf9e-3bd7-4290-a731-66fee014393f service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:24.063558 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-ca16ddc5-44f0-4055-95a8-9121ae14b34e req-7f53bf9e-3bd7-4290-a731-66fee014393f service nova] Creating event network-changed:ebfe0ce8-aac6-476b-a756-32c12fac0eb3 for instance bde36abe-c87d-457c-b41a-040288d694da on hv-cinder-82189 Dec 16 14:52:24.070531 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-ca16ddc5-44f0-4055-95a8-9121ae14b34e req-7f53bf9e-3bd7-4290-a731-66fee014393f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046989 Dec 16 14:52:24.071269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 548/1111] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:52:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:52:24.591334 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-eaa0c2e5-a147-4a62-94c9-19db3e114d19 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:24.591882 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-eaa0c2e5-a147-4a62-94c9-19db3e114d19 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:24.599046 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eaa0c2e5-a147-4a62-94c9-19db3e114d19 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:24.599484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eaa0c2e5-a147-4a62-94c9-19db3e114d19 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:24.600236 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eaa0c2e5-a147-4a62-94c9-19db3e114d19 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:24.600660 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-eaa0c2e5-a147-4a62-94c9-19db3e114d19 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:24.792671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-eaa0c2e5-a147-4a62-94c9-19db3e114d19 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:24.801335 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-eaa0c2e5-a147-4a62-94c9-19db3e114d19 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.213817 Dec 16 14:52:24.801880 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 564/1112] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:24 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:25.819155 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-2b8dd822-afe3-4aac-84ab-11a8ef6890a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:25.819855 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-2b8dd822-afe3-4aac-84ab-11a8ef6890a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:25.827435 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b8dd822-afe3-4aac-84ab-11a8ef6890a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:25.827893 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b8dd822-afe3-4aac-84ab-11a8ef6890a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:25.828664 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b8dd822-afe3-4aac-84ab-11a8ef6890a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:25.829125 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-2b8dd822-afe3-4aac-84ab-11a8ef6890a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:26.025206 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-2b8dd822-afe3-4aac-84ab-11a8ef6890a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:26.033935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-2b8dd822-afe3-4aac-84ab-11a8ef6890a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.218951 Dec 16 14:52:26.034496 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 549/1113] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:25 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:27.051156 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-c5f4b18d-8fe5-47cb-8668-5a9185160957 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:27.051697 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-c5f4b18d-8fe5-47cb-8668-5a9185160957 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:27.059141 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c5f4b18d-8fe5-47cb-8668-5a9185160957 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:27.059574 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c5f4b18d-8fe5-47cb-8668-5a9185160957 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:27.060915 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c5f4b18d-8fe5-47cb-8668-5a9185160957 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:27.061342 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-c5f4b18d-8fe5-47cb-8668-5a9185160957 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:27.255413 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-c5f4b18d-8fe5-47cb-8668-5a9185160957 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:27.264385 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-c5f4b18d-8fe5-47cb-8668-5a9185160957 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.216992 Dec 16 14:52:27.264969 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 565/1114] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:27 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:52:28.280993 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b106f908-8260-48b7-8067-d4c586fcb5df tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:28.281601 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b106f908-8260-48b7-8067-d4c586fcb5df tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:28.288962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b106f908-8260-48b7-8067-d4c586fcb5df tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:28.289357 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b106f908-8260-48b7-8067-d4c586fcb5df tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:28.290116 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b106f908-8260-48b7-8067-d4c586fcb5df tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:28.290548 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b106f908-8260-48b7-8067-d4c586fcb5df tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:28.485127 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-b106f908-8260-48b7-8067-d4c586fcb5df tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:28.493601 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b106f908-8260-48b7-8067-d4c586fcb5df tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.216293 Dec 16 14:52:28.494192 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 550/1115] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:28 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:29.510844 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-b6e76850-0fa9-4c7c-8446-09e8a4396fa0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:29.511435 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-b6e76850-0fa9-4c7c-8446-09e8a4396fa0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:29.519298 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b6e76850-0fa9-4c7c-8446-09e8a4396fa0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:29.519749 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b6e76850-0fa9-4c7c-8446-09e8a4396fa0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:29.520519 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b6e76850-0fa9-4c7c-8446-09e8a4396fa0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:29.520989 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-b6e76850-0fa9-4c7c-8446-09e8a4396fa0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:29.835432 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-b6e76850-0fa9-4c7c-8446-09e8a4396fa0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:29.844217 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-b6e76850-0fa9-4c7c-8446-09e8a4396fa0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.336989 Dec 16 14:52:29.844816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 566/1116] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:29 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:30.860319 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-17c8f327-8c36-4b47-9b89-be7bdb1c4811 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:30.860879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-17c8f327-8c36-4b47-9b89-be7bdb1c4811 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:30.868733 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-17c8f327-8c36-4b47-9b89-be7bdb1c4811 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:30.869212 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-17c8f327-8c36-4b47-9b89-be7bdb1c4811 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:30.869971 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-17c8f327-8c36-4b47-9b89-be7bdb1c4811 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:30.870602 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-17c8f327-8c36-4b47-9b89-be7bdb1c4811 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:31.081685 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-17c8f327-8c36-4b47-9b89-be7bdb1c4811 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:31.090095 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-17c8f327-8c36-4b47-9b89-be7bdb1c4811 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.233438 Dec 16 14:52:31.090737 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 551/1117] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:30 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:32.107004 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0081e857-919e-4e85-9751-698de9356f78 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:32.107613 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0081e857-919e-4e85-9751-698de9356f78 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:32.115623 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0081e857-919e-4e85-9751-698de9356f78 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:32.116067 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0081e857-919e-4e85-9751-698de9356f78 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:32.116841 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0081e857-919e-4e85-9751-698de9356f78 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:32.117271 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0081e857-919e-4e85-9751-698de9356f78 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:32.311516 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0081e857-919e-4e85-9751-698de9356f78 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:32.319501 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0081e857-919e-4e85-9751-698de9356f78 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.216130 Dec 16 14:52:32.320153 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 567/1118] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:32 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:33.336591 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f9040ff3-a243-4e22-8726-926c75a1b468 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:33.337238 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f9040ff3-a243-4e22-8726-926c75a1b468 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:33.345135 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f9040ff3-a243-4e22-8726-926c75a1b468 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:33.345584 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f9040ff3-a243-4e22-8726-926c75a1b468 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:33.346343 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f9040ff3-a243-4e22-8726-926c75a1b468 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:33.346775 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f9040ff3-a243-4e22-8726-926c75a1b468 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:33.541011 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f9040ff3-a243-4e22-8726-926c75a1b468 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:33.549611 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f9040ff3-a243-4e22-8726-926c75a1b468 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.216769 Dec 16 14:52:33.550176 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 552/1119] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:33 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:34.566351 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2b2b9824-cd0b-4586-a7e8-79504edf35fa tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:34.566931 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2b2b9824-cd0b-4586-a7e8-79504edf35fa tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:34.574289 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b2b9824-cd0b-4586-a7e8-79504edf35fa tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:34.574730 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b2b9824-cd0b-4586-a7e8-79504edf35fa tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:34.575478 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b2b9824-cd0b-4586-a7e8-79504edf35fa tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:34.575901 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2b2b9824-cd0b-4586-a7e8-79504edf35fa tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:34.766281 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2b2b9824-cd0b-4586-a7e8-79504edf35fa tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:34.774296 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2b2b9824-cd0b-4586-a7e8-79504edf35fa tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.211629 Dec 16 14:52:34.774845 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 568/1120] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:34 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:35.791372 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-059384c7-2cd5-4a8a-af07-120fb9b89286 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:35.791962 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-059384c7-2cd5-4a8a-af07-120fb9b89286 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:35.799905 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-059384c7-2cd5-4a8a-af07-120fb9b89286 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:35.800385 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-059384c7-2cd5-4a8a-af07-120fb9b89286 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:35.801207 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-059384c7-2cd5-4a8a-af07-120fb9b89286 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:35.801639 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-059384c7-2cd5-4a8a-af07-120fb9b89286 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:36.001335 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-059384c7-2cd5-4a8a-af07-120fb9b89286 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:36.009433 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-059384c7-2cd5-4a8a-af07-120fb9b89286 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.221812 Dec 16 14:52:36.009996 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 553/1121] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:35 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:37.026219 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-34cbcbf5-1446-44ca-b5e4-6d00741ca058 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:37.026821 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-34cbcbf5-1446-44ca-b5e4-6d00741ca058 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:37.034714 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34cbcbf5-1446-44ca-b5e4-6d00741ca058 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:37.035189 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34cbcbf5-1446-44ca-b5e4-6d00741ca058 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:37.035963 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34cbcbf5-1446-44ca-b5e4-6d00741ca058 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:37.036389 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-34cbcbf5-1446-44ca-b5e4-6d00741ca058 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:37.236649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-34cbcbf5-1446-44ca-b5e4-6d00741ca058 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:37.245484 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-34cbcbf5-1446-44ca-b5e4-6d00741ca058 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.222839 Dec 16 14:52:37.246147 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 569/1122] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:37 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:38.263012 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-0238a3e0-9108-41d8-bf28-6521bf6380ee tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:38.263603 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-0238a3e0-9108-41d8-bf28-6521bf6380ee tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:38.270949 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0238a3e0-9108-41d8-bf28-6521bf6380ee tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:38.271404 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0238a3e0-9108-41d8-bf28-6521bf6380ee tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:38.272184 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0238a3e0-9108-41d8-bf28-6521bf6380ee tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:38.272620 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-0238a3e0-9108-41d8-bf28-6521bf6380ee tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:38.463457 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-0238a3e0-9108-41d8-bf28-6521bf6380ee tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:38.471606 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-0238a3e0-9108-41d8-bf28-6521bf6380ee tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.212339 Dec 16 14:52:38.472162 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 554/1123] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:38 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:39.488157 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-36d72c49-e0f0-4dbb-9176-89dfb3e0b42c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:39.488759 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-36d72c49-e0f0-4dbb-9176-89dfb3e0b42c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:39.495945 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-36d72c49-e0f0-4dbb-9176-89dfb3e0b42c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:39.496391 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-36d72c49-e0f0-4dbb-9176-89dfb3e0b42c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:39.497195 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-36d72c49-e0f0-4dbb-9176-89dfb3e0b42c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:39.497630 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-36d72c49-e0f0-4dbb-9176-89dfb3e0b42c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:39.693021 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-36d72c49-e0f0-4dbb-9176-89dfb3e0b42c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:39.701210 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-36d72c49-e0f0-4dbb-9176-89dfb3e0b42c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.216721 Dec 16 14:52:39.701820 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 570/1124] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:39 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:40.718295 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-cd1f4916-1b91-4988-9b62-2944d5cde106 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:40.718879 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-cd1f4916-1b91-4988-9b62-2944d5cde106 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:40.726111 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cd1f4916-1b91-4988-9b62-2944d5cde106 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:40.726552 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cd1f4916-1b91-4988-9b62-2944d5cde106 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:40.727305 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cd1f4916-1b91-4988-9b62-2944d5cde106 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:40.727732 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-cd1f4916-1b91-4988-9b62-2944d5cde106 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:40.927925 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-cd1f4916-1b91-4988-9b62-2944d5cde106 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:40.937002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-cd1f4916-1b91-4988-9b62-2944d5cde106 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.222452 Dec 16 14:52:40.937581 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 555/1125] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:40 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:41.954052 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5ae8bb91-3d78-4d0d-a4ee-dfb17b014148 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:41.954683 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5ae8bb91-3d78-4d0d-a4ee-dfb17b014148 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:41.962473 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ae8bb91-3d78-4d0d-a4ee-dfb17b014148 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:41.963141 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ae8bb91-3d78-4d0d-a4ee-dfb17b014148 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:41.963917 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ae8bb91-3d78-4d0d-a4ee-dfb17b014148 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:41.964344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5ae8bb91-3d78-4d0d-a4ee-dfb17b014148 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:42.202341 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5ae8bb91-3d78-4d0d-a4ee-dfb17b014148 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:42.210808 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5ae8bb91-3d78-4d0d-a4ee-dfb17b014148 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.261004 Dec 16 14:52:42.211379 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 571/1126] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:41 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:42.472423 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-5d3fd603-b051-47d3-a707-b9b34bac7710 req-d8e94937-bda4-46e8-b6cc-faa2bd9db641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde36abe-c87d-457c-b41a-040288d694da", "name": "network-vif-plugged", "status": "completed", "tag": "ebfe0ce8-aac6-476b-a756-32c12fac0eb3"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:52:42.474077 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:52:42.474077 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:52:42.489153 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-5d3fd603-b051-47d3-a707-b9b34bac7710 req-d8e94937-bda4-46e8-b6cc-faa2bd9db641 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:42.489771 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-5d3fd603-b051-47d3-a707-b9b34bac7710 req-d8e94937-bda4-46e8-b6cc-faa2bd9db641 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:42.509536 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-5d3fd603-b051-47d3-a707-b9b34bac7710 req-d8e94937-bda4-46e8-b6cc-faa2bd9db641 service nova] Creating event network-vif-plugged:ebfe0ce8-aac6-476b-a756-32c12fac0eb3 for instance bde36abe-c87d-457c-b41a-040288d694da on hv-cinder-82189 Dec 16 14:52:42.514976 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-5d3fd603-b051-47d3-a707-b9b34bac7710 req-d8e94937-bda4-46e8-b6cc-faa2bd9db641 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045528 Dec 16 14:52:42.515698 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 556/1127] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:52:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:52:43.227439 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-106169e6-2f79-4d8f-be5b-43256ebc84a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:43.228054 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-106169e6-2f79-4d8f-be5b-43256ebc84a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:43.235993 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-106169e6-2f79-4d8f-be5b-43256ebc84a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:43.236442 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-106169e6-2f79-4d8f-be5b-43256ebc84a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:43.237237 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-106169e6-2f79-4d8f-be5b-43256ebc84a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:43.237672 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-106169e6-2f79-4d8f-be5b-43256ebc84a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:43.442176 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-106169e6-2f79-4d8f-be5b-43256ebc84a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:43.450288 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-106169e6-2f79-4d8f-be5b-43256ebc84a2 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1266 microversion: 2.1 time: 0.226752 Dec 16 14:52:43.450851 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 572/1128] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:43 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:44.470147 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8a3a7563-d870-480e-9bd9-9ce5dd751527 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:44.470835 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8a3a7563-d870-480e-9bd9-9ce5dd751527 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:44.478626 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a3a7563-d870-480e-9bd9-9ce5dd751527 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:44.479072 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a3a7563-d870-480e-9bd9-9ce5dd751527 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:44.479876 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a3a7563-d870-480e-9bd9-9ce5dd751527 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:44.480305 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a3a7563-d870-480e-9bd9-9ce5dd751527 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:44.680343 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-8a3a7563-d870-480e-9bd9-9ce5dd751527 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:44.688921 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8a3a7563-d870-480e-9bd9-9ce5dd751527 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1451 microversion: 2.1 time: 0.222886 Dec 16 14:52:44.689490 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 557/1129] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:44 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1451 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:44.704929 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-0f6f8287-cb09-4b89-b4d0-d183df8d9e91 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:52:44.705576 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-0f6f8287-cb09-4b89-b4d0-d183df8d9e91 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:52:44.713063 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0f6f8287-cb09-4b89-b4d0-d183df8d9e91 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:44.715391 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0f6f8287-cb09-4b89-b4d0-d183df8d9e91 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:44.715391 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0f6f8287-cb09-4b89-b4d0-d183df8d9e91 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:44.715391 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-0f6f8287-cb09-4b89-b4d0-d183df8d9e91 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:45.017614 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-0f6f8287-cb09-4b89-b4d0-d183df8d9e91 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:52:45.026432 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-0f6f8287-cb09-4b89-b4d0-d183df8d9e91 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1451 microversion: 2.1 time: 0.325377 Dec 16 14:52:45.026865 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 573/1130] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:52:44 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1451 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:52:47.461175 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [req-60777f1d-0a28-4072-96f2-24f84cf64950 req-52123742-003f-4204-aaf1-30bee2a49442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde36abe-c87d-457c-b41a-040288d694da", "tag": "ebfe0ce8-aac6-476b-a756-32c12fac0eb3"}]} {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:52:47.461632 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:52:47.461632 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: warnings.warn(msg) Dec 16 14:52:47.470129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-60777f1d-0a28-4072-96f2-24f84cf64950 req-52123742-003f-4204-aaf1-30bee2a49442 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:52:47.470573 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [req-60777f1d-0a28-4072-96f2-24f84cf64950 req-52123742-003f-4204-aaf1-30bee2a49442 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:52:47.487651 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.compute.server_external_events [req-60777f1d-0a28-4072-96f2-24f84cf64950 req-52123742-003f-4204-aaf1-30bee2a49442 service nova] Creating event network-changed:ebfe0ce8-aac6-476b-a756-32c12fac0eb3 for instance bde36abe-c87d-457c-b41a-040288d694da on hv-cinder-82189 Dec 16 14:52:47.492761 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [req-60777f1d-0a28-4072-96f2-24f84cf64950 req-52123742-003f-4204-aaf1-30bee2a49442 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036257 Dec 16 14:52:47.493399 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 558/1131] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:52:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:52:53.694964 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:52:53.695512 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: Thu Dec 16 14:52:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 14:54:26.780108 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1146606503", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1174908289", "security_groups": [{"name": "tempest-secgroup-smoke-1001105392"}], "block_device_mapping_v2": [{"uuid": "56190e12-8086-444b-85b6-3fa98e002020", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9786e867-a38a-4109-abba-499d29f3c81d"}]}} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:54:26.792991 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d989187-3e87-46c2-8fd9-84acac2d774c] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 14:54:26.955033 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.network.neutron [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] validate_networks() for [('9786e867-a38a-4109-abba-499d29f3c81d', None, None, None)] {{(pid=101914) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Dec 16 14:54:27.651305 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Flavor limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 16 14:54:27.651816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Image limits 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 16 14:54:27.652338 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Flavor pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 16 14:54:27.652825 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Image pref 0:0:0 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 16 14:54:27.653399 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.virt.hardware [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 16 14:54:27.662695 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:27.663141 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:27.663941 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:27.664369 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:27.683760 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Getting quotas for project d963a0aa72964047885ee0212d5055dc. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 14:54:27.688316 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.quota [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Getting quotas for user ee703ae6a79f48cdb9438f504085e206 and project d963a0aa72964047885ee0212d5055dc. Resources: {'instances', 'cores', 'ram'} {{(pid=101914) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 14:54:27.794379 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Going to run 1 instances... {{(pid=101914) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Dec 16 14:54:27.798151 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56190e12-8086-444b-85b6-3fa98e002020',volume_size=None,volume_type=None)] {{(pid=101914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Dec 16 14:54:27.830770 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d989187-3e87-46c2-8fd9-84acac2d774c] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 59462. Dec 16 14:54:28.034058 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-8247ac2f-75d4-4d01-8630-6ab4940b76bc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.257683 Dec 16 14:54:28.040679 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 574/1132] 10.222.0.64 () {60 vars in 1146 bytes} [Thu Dec 16 14:54:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:54:28.045153 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8f475ad-ad4a-422f-83ac-7c24244cd8bc] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:54:28.051877 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f83b783d-a020-4b4b-9e17-c89cdbc3700e tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:28.053103 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f83b783d-a020-4b4b-9e17-c89cdbc3700e tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:28.189212 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f83b783d-a020-4b4b-9e17-c89cdbc3700e tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:28.198519 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f83b783d-a020-4b4b-9e17-c89cdbc3700e tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1095 microversion: 2.1 time: 0.154920 Dec 16 14:54:28.199859 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 559/1133] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:28 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1095 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:54:29.223341 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-fc1f295d-db3f-4606-b938-8d17730cc49d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:29.224039 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-fc1f295d-db3f-4606-b938-8d17730cc49d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:29.231843 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fc1f295d-db3f-4606-b938-8d17730cc49d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:29.232285 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fc1f295d-db3f-4606-b938-8d17730cc49d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:29.233104 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fc1f295d-db3f-4606-b938-8d17730cc49d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:29.233542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-fc1f295d-db3f-4606-b938-8d17730cc49d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:29.530859 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-fc1f295d-db3f-4606-b938-8d17730cc49d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:29.542022 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-fc1f295d-db3f-4606-b938-8d17730cc49d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1201 microversion: 2.1 time: 0.322049 Dec 16 14:54:29.542719 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 575/1134] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:29 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1201 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:30.563608 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a6b9dc88-1a17-4757-8ec9-9d69671d5e01 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:30.572382 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a6b9dc88-1a17-4757-8ec9-9d69671d5e01 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:30.599079 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a6b9dc88-1a17-4757-8ec9-9d69671d5e01 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:30.599537 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a6b9dc88-1a17-4757-8ec9-9d69671d5e01 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:30.600350 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a6b9dc88-1a17-4757-8ec9-9d69671d5e01 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:30.600808 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a6b9dc88-1a17-4757-8ec9-9d69671d5e01 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:30.603385 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8f475ad-ad4a-422f-83ac-7c24244cd8bc] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 59480. Dec 16 14:54:31.041274 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-a6b9dc88-1a17-4757-8ec9-9d69671d5e01 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:31.057078 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a6b9dc88-1a17-4757-8ec9-9d69671d5e01 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.499470 Dec 16 14:54:31.058986 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 560/1135] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:30 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:31.825269 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-220faf14-6cd7-46c0-bb7f-d70871612538 req-e558139e-65d8-48bc-855c-65bf33c7a4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8", "tag": "34ca8e4d-518e-4fc0-a16a-553b42961ea9"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:54:31.826893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:54:31.826893 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:54:31.845271 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-220faf14-6cd7-46c0-bb7f-d70871612538 req-e558139e-65d8-48bc-855c-65bf33c7a4b0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:31.845725 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-220faf14-6cd7-46c0-bb7f-d70871612538 req-e558139e-65d8-48bc-855c-65bf33c7a4b0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:31.865858 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-220faf14-6cd7-46c0-bb7f-d70871612538 req-e558139e-65d8-48bc-855c-65bf33c7a4b0 service nova] Creating event network-changed:34ca8e4d-518e-4fc0-a16a-553b42961ea9 for instance 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 on hv-cinder-82189 Dec 16 14:54:31.870986 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-220faf14-6cd7-46c0-bb7f-d70871612538 req-e558139e-65d8-48bc-855c-65bf33c7a4b0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051712 Dec 16 14:54:31.871595 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 576/1136] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:54:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:54:32.082930 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-a8b7af8c-1c3e-450d-a4d2-86fbd2cfc863 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:32.083503 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-a8b7af8c-1c3e-450d-a4d2-86fbd2cfc863 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:32.091858 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a8b7af8c-1c3e-450d-a4d2-86fbd2cfc863 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:32.091858 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a8b7af8c-1c3e-450d-a4d2-86fbd2cfc863 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:32.097164 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a8b7af8c-1c3e-450d-a4d2-86fbd2cfc863 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:32.097635 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-a8b7af8c-1c3e-450d-a4d2-86fbd2cfc863 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:32.443204 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-a8b7af8c-1c3e-450d-a4d2-86fbd2cfc863 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:32.452247 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-a8b7af8c-1c3e-450d-a4d2-86fbd2cfc863 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.373311 Dec 16 14:54:32.453309 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 561/1137] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:32 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:33.470228 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1f489a06-a751-4aaf-b1e9-a3de715280cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:33.470936 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1f489a06-a751-4aaf-b1e9-a3de715280cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:33.478671 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1f489a06-a751-4aaf-b1e9-a3de715280cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:33.479107 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1f489a06-a751-4aaf-b1e9-a3de715280cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:33.479899 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1f489a06-a751-4aaf-b1e9-a3de715280cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:33.480333 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1f489a06-a751-4aaf-b1e9-a3de715280cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:33.776914 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1f489a06-a751-4aaf-b1e9-a3de715280cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:33.785458 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1f489a06-a751-4aaf-b1e9-a3de715280cf tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.319656 Dec 16 14:54:33.786024 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 577/1138] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:33 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:34.802569 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-68c000fc-563a-4d3f-840d-c035f52ca60f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:34.803810 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-68c000fc-563a-4d3f-840d-c035f52ca60f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:34.811985 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-68c000fc-563a-4d3f-840d-c035f52ca60f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:34.812691 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-68c000fc-563a-4d3f-840d-c035f52ca60f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:34.813512 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-68c000fc-563a-4d3f-840d-c035f52ca60f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:34.813950 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-68c000fc-563a-4d3f-840d-c035f52ca60f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:35.013674 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-68c000fc-563a-4d3f-840d-c035f52ca60f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:35.021906 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-68c000fc-563a-4d3f-840d-c035f52ca60f tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.223025 Dec 16 14:54:35.022458 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 562/1139] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:34 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:36.038824 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-1f6cbf98-ecac-4c5f-8903-e8151e0990fe tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:36.039442 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-1f6cbf98-ecac-4c5f-8903-e8151e0990fe tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:36.047674 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1f6cbf98-ecac-4c5f-8903-e8151e0990fe tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:36.048122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1f6cbf98-ecac-4c5f-8903-e8151e0990fe tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:36.048941 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1f6cbf98-ecac-4c5f-8903-e8151e0990fe tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:36.049379 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-1f6cbf98-ecac-4c5f-8903-e8151e0990fe tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:36.247024 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-1f6cbf98-ecac-4c5f-8903-e8151e0990fe tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:36.255378 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-1f6cbf98-ecac-4c5f-8903-e8151e0990fe tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.220325 Dec 16 14:54:36.255959 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 578/1140] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:36 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:37.428707 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-45688b91-798a-49b3-bc52-62b110922f65 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:37.429380 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-45688b91-798a-49b3-bc52-62b110922f65 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:37.437321 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-45688b91-798a-49b3-bc52-62b110922f65 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:37.437769 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-45688b91-798a-49b3-bc52-62b110922f65 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:37.438585 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-45688b91-798a-49b3-bc52-62b110922f65 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:37.439085 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-45688b91-798a-49b3-bc52-62b110922f65 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:37.640348 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-45688b91-798a-49b3-bc52-62b110922f65 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:37.648902 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-45688b91-798a-49b3-bc52-62b110922f65 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.379901 Dec 16 14:54:37.649475 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 563/1141] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:37 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:38.666474 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-bafe847a-6972-4046-94eb-14d0b1219db9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:38.667064 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-bafe847a-6972-4046-94eb-14d0b1219db9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:38.674165 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bafe847a-6972-4046-94eb-14d0b1219db9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:38.674595 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bafe847a-6972-4046-94eb-14d0b1219db9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:38.675343 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bafe847a-6972-4046-94eb-14d0b1219db9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:38.675765 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-bafe847a-6972-4046-94eb-14d0b1219db9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:38.870835 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-bafe847a-6972-4046-94eb-14d0b1219db9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:38.879175 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-bafe847a-6972-4046-94eb-14d0b1219db9 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.216379 Dec 16 14:54:38.879752 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 579/1142] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:38 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:39.896669 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-d0e43958-0966-4e35-ad48-22b6cb6e66bb tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:39.897307 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-d0e43958-0966-4e35-ad48-22b6cb6e66bb tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:39.905270 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d0e43958-0966-4e35-ad48-22b6cb6e66bb tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:39.905712 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d0e43958-0966-4e35-ad48-22b6cb6e66bb tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:39.906466 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d0e43958-0966-4e35-ad48-22b6cb6e66bb tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:39.906896 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-d0e43958-0966-4e35-ad48-22b6cb6e66bb tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:40.107645 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-d0e43958-0966-4e35-ad48-22b6cb6e66bb tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:40.115911 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-d0e43958-0966-4e35-ad48-22b6cb6e66bb tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.222844 Dec 16 14:54:40.116494 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 564/1143] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:39 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:41.132172 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-9d9a3fb0-708d-473b-9736-08d3871b5504 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:41.132802 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-9d9a3fb0-708d-473b-9736-08d3871b5504 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:41.140044 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d9a3fb0-708d-473b-9736-08d3871b5504 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:41.140490 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d9a3fb0-708d-473b-9736-08d3871b5504 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:41.141295 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d9a3fb0-708d-473b-9736-08d3871b5504 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:41.141732 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-9d9a3fb0-708d-473b-9736-08d3871b5504 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:41.347608 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-9d9a3fb0-708d-473b-9736-08d3871b5504 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:41.357025 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-9d9a3fb0-708d-473b-9736-08d3871b5504 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.228434 Dec 16 14:54:41.357739 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 580/1144] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:41 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:42.373564 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-3ac41102-9288-4861-8180-69ee439aaba3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:42.374145 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-3ac41102-9288-4861-8180-69ee439aaba3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:42.381542 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ac41102-9288-4861-8180-69ee439aaba3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:42.382002 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ac41102-9288-4861-8180-69ee439aaba3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:42.382750 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ac41102-9288-4861-8180-69ee439aaba3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:42.383179 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-3ac41102-9288-4861-8180-69ee439aaba3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:42.583539 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-3ac41102-9288-4861-8180-69ee439aaba3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:42.592129 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-3ac41102-9288-4861-8180-69ee439aaba3 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.222975 Dec 16 14:54:42.592683 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 565/1145] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:42 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:42.998667 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-77ab7d03-4f32-48d5-924c-f45bb5576cde req-6715d4a3-cc73-491a-b706-c6a6713e1059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8", "name": "network-vif-plugged", "status": "completed", "tag": "34ca8e4d-518e-4fc0-a16a-553b42961ea9"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:54:43.000220 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:54:43.000220 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:54:43.010160 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-77ab7d03-4f32-48d5-924c-f45bb5576cde req-6715d4a3-cc73-491a-b706-c6a6713e1059 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:43.010597 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-77ab7d03-4f32-48d5-924c-f45bb5576cde req-6715d4a3-cc73-491a-b706-c6a6713e1059 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:43.026076 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-77ab7d03-4f32-48d5-924c-f45bb5576cde req-6715d4a3-cc73-491a-b706-c6a6713e1059 service nova] Creating event network-vif-plugged:34ca8e4d-518e-4fc0-a16a-553b42961ea9 for instance 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 on hv-cinder-82189 Dec 16 14:54:43.031054 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-77ab7d03-4f32-48d5-924c-f45bb5576cde req-6715d4a3-cc73-491a-b706-c6a6713e1059 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036574 Dec 16 14:54:43.031905 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 581/1146] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:54:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:54:43.608775 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7fdef263-a8bc-4002-8b5e-fbbafbe9888d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:43.609410 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7fdef263-a8bc-4002-8b5e-fbbafbe9888d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:43.617432 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7fdef263-a8bc-4002-8b5e-fbbafbe9888d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:43.617881 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7fdef263-a8bc-4002-8b5e-fbbafbe9888d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:43.618675 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7fdef263-a8bc-4002-8b5e-fbbafbe9888d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:43.619102 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7fdef263-a8bc-4002-8b5e-fbbafbe9888d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:43.820745 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7fdef263-a8bc-4002-8b5e-fbbafbe9888d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:43.830953 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7fdef263-a8bc-4002-8b5e-fbbafbe9888d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1267 microversion: 2.1 time: 0.225892 Dec 16 14:54:43.831641 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 566/1147] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:43 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:44.848285 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-5959fd7e-ecc3-4697-b8dd-25bc908d5695 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:44.849036 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-5959fd7e-ecc3-4697-b8dd-25bc908d5695 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:44.857410 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5959fd7e-ecc3-4697-b8dd-25bc908d5695 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:44.857860 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5959fd7e-ecc3-4697-b8dd-25bc908d5695 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:44.858635 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5959fd7e-ecc3-4697-b8dd-25bc908d5695 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:44.859102 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-5959fd7e-ecc3-4697-b8dd-25bc908d5695 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:45.062954 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-5959fd7e-ecc3-4697-b8dd-25bc908d5695 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:45.071075 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-5959fd7e-ecc3-4697-b8dd-25bc908d5695 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1452 microversion: 2.1 time: 0.227053 Dec 16 14:54:45.071626 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 582/1148] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:44 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:45.087269 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-183a58c0-5778-48f7-b725-0d850bba3a82 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:54:45.087910 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-183a58c0-5778-48f7-b725-0d850bba3a82 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:54:45.095818 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-183a58c0-5778-48f7-b725-0d850bba3a82 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:45.096268 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-183a58c0-5778-48f7-b725-0d850bba3a82 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:45.097065 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-183a58c0-5778-48f7-b725-0d850bba3a82 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:45.097501 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-183a58c0-5778-48f7-b725-0d850bba3a82 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:45.296701 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-183a58c0-5778-48f7-b725-0d850bba3a82 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:54:45.304851 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-183a58c0-5778-48f7-b725-0d850bba3a82 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1452 microversion: 2.1 time: 0.221281 Dec 16 14:54:45.305419 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 567/1149] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:54:45 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1452 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:54:47.882872 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-7948b137-3786-4e17-90bd-3b1d70d4e89a req-5f3ee0ee-7586-4183-8964-7bbc200b6522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8", "tag": "34ca8e4d-518e-4fc0-a16a-553b42961ea9"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:54:47.884419 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:54:47.884419 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:54:47.893261 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-7948b137-3786-4e17-90bd-3b1d70d4e89a req-5f3ee0ee-7586-4183-8964-7bbc200b6522 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:54:47.893693 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-7948b137-3786-4e17-90bd-3b1d70d4e89a req-5f3ee0ee-7586-4183-8964-7bbc200b6522 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:54:47.910930 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-7948b137-3786-4e17-90bd-3b1d70d4e89a req-5f3ee0ee-7586-4183-8964-7bbc200b6522 service nova] Creating event network-changed:34ca8e4d-518e-4fc0-a16a-553b42961ea9 for instance 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 on hv-cinder-82189 Dec 16 14:54:47.917282 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-7948b137-3786-4e17-90bd-3b1d70d4e89a req-5f3ee0ee-7586-4183-8964-7bbc200b6522 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037651 Dec 16 14:54:47.918201 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 583/1150] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:54:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:54:59.268617 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:54:59.269292 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: Thu Dec 16 14:54:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 14:56:13.712926 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:56:13.713593 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: Thu Dec 16 14:56:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 14:56:20.230784 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-8a2c8619-0d30-4fe9-92bc-9541c1fdfb6d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:20.232414 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8a2c8619-0d30-4fe9-92bc-9541c1fdfb6d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:20.246302 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a2c8619-0d30-4fe9-92bc-9541c1fdfb6d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:20.247075 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a2c8619-0d30-4fe9-92bc-9541c1fdfb6d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:20.248060 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a2c8619-0d30-4fe9-92bc-9541c1fdfb6d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:20.248644 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-8a2c8619-0d30-4fe9-92bc-9541c1fdfb6d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:20.325000 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-8a2c8619-0d30-4fe9-92bc-9541c1fdfb6d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:56:20.333967 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-2df236ee-e32e-4cbf-8581-93aed7040efa req-0018e525-03b0-48a1-a6e0-1a54a68e0125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8", "tag": "34ca8e4d-518e-4fc0-a16a-553b42961ea9"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:56:20.336685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:20.336685 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:56:20.347005 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-2df236ee-e32e-4cbf-8581-93aed7040efa req-0018e525-03b0-48a1-a6e0-1a54a68e0125 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:20.347452 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-2df236ee-e32e-4cbf-8581-93aed7040efa req-0018e525-03b0-48a1-a6e0-1a54a68e0125 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:20.366286 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-2df236ee-e32e-4cbf-8581-93aed7040efa req-0018e525-03b0-48a1-a6e0-1a54a68e0125 service nova] Creating event network-changed:34ca8e4d-518e-4fc0-a16a-553b42961ea9 for instance 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 on hv-cinder-82189 Dec 16 14:56:20.372292 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-2df236ee-e32e-4cbf-8581-93aed7040efa req-0018e525-03b0-48a1-a6e0-1a54a68e0125 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143905 Dec 16 14:56:20.373774 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 584/1151] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:56:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:20.470292 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-8a2c8619-0d30-4fe9-92bc-9541c1fdfb6d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 204 len: 0 microversion: 2.1 time: 0.243171 Dec 16 14:56:20.471569 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 568/1152] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:56:20 2021] DELETE /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:56:20.482698 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-499c5df1-39d1-42fc-95bf-5d448bceb306 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:20.483863 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-499c5df1-39d1-42fc-95bf-5d448bceb306 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:20.493521 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-499c5df1-39d1-42fc-95bf-5d448bceb306 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:20.494120 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-499c5df1-39d1-42fc-95bf-5d448bceb306 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:20.495309 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-499c5df1-39d1-42fc-95bf-5d448bceb306 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:20.495476 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-499c5df1-39d1-42fc-95bf-5d448bceb306 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:21.019422 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-499c5df1-39d1-42fc-95bf-5d448bceb306 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:56:21.030839 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-499c5df1-39d1-42fc-95bf-5d448bceb306 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1577 microversion: 2.1 time: 0.554276 Dec 16 14:56:21.031550 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 585/1153] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:56:20 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1577 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:22.053041 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-e8d638f2-fcbc-41a3-a791-4db429e1631b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:22.053749 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-e8d638f2-fcbc-41a3-a791-4db429e1631b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:22.061409 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8d638f2-fcbc-41a3-a791-4db429e1631b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:22.061866 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8d638f2-fcbc-41a3-a791-4db429e1631b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:22.062648 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8d638f2-fcbc-41a3-a791-4db429e1631b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:22.063085 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-e8d638f2-fcbc-41a3-a791-4db429e1631b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:22.443045 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-e8d638f2-fcbc-41a3-a791-4db429e1631b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:56:22.451580 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-e8d638f2-fcbc-41a3-a791-4db429e1631b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1458 microversion: 2.1 time: 0.402684 Dec 16 14:56:22.452164 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 569/1154] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:56:22 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1458 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:23.151939 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-fc341280-85e4-4a9c-b762-1f6d7b2d64bc req-2158d388-4698-4069-ba92-e9611aff17e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8", "name": "network-vif-deleted", "tag": "34ca8e4d-518e-4fc0-a16a-553b42961ea9"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:56:23.153470 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:23.153470 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:56:23.162631 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-fc341280-85e4-4a9c-b762-1f6d7b2d64bc req-2158d388-4698-4069-ba92-e9611aff17e4 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:23.163079 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-fc341280-85e4-4a9c-b762-1f6d7b2d64bc req-2158d388-4698-4069-ba92-e9611aff17e4 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:23.180122 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-fc341280-85e4-4a9c-b762-1f6d7b2d64bc req-2158d388-4698-4069-ba92-e9611aff17e4 service nova] Creating event network-vif-deleted:34ca8e4d-518e-4fc0-a16a-553b42961ea9 for instance 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 on hv-cinder-82189 Dec 16 14:56:23.185544 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-fc341280-85e4-4a9c-b762-1f6d7b2d64bc req-2158d388-4698-4069-ba92-e9611aff17e4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037186 Dec 16 14:56:23.186648 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 586/1155] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:56:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:23.468979 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-961d1dea-f158-416f-81b1-38db5141eec0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:23.469596 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-961d1dea-f158-416f-81b1-38db5141eec0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:23.477322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-961d1dea-f158-416f-81b1-38db5141eec0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:23.477772 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-961d1dea-f158-416f-81b1-38db5141eec0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:23.478547 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-961d1dea-f158-416f-81b1-38db5141eec0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:23.478982 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-961d1dea-f158-416f-81b1-38db5141eec0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:23.613561 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-961d1dea-f158-416f-81b1-38db5141eec0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:56:23.628322 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-961d1dea-f158-416f-81b1-38db5141eec0 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 200 len: 1226 microversion: 2.1 time: 0.162648 Dec 16 14:56:23.629399 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 570/1156] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:56:23 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 1226 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:24.654044 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4a591c10-9a50-4b23-8af3-58c76fb48243 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:24.654756 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-4a591c10-9a50-4b23-8af3-58c76fb48243 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:24.662649 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4a591c10-9a50-4b23-8af3-58c76fb48243 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:24.663099 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4a591c10-9a50-4b23-8af3-58c76fb48243 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:24.663903 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4a591c10-9a50-4b23-8af3-58c76fb48243 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:24.664344 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-4a591c10-9a50-4b23-8af3-58c76fb48243 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:24.715119 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-4a591c10-9a50-4b23-8af3-58c76fb48243 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] HTTP exception thrown: Instance 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 could not be found. Dec 16 14:56:24.715719 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-4a591c10-9a50-4b23-8af3-58c76fb48243 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Returning 404 to user: Instance 4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:56:24.716551 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-4a591c10-9a50-4b23-8af3-58c76fb48243 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8" status: 404 len: 111 microversion: 2.1 time: 0.067059 Dec 16 14:56:24.717150 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 587/1157] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:56:24 2021] GET /compute/v2.1/servers/4c7a5d5b-29c9-4a63-827f-6efdc18b1ed8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:56:28.892560 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-1f8933ef-7acb-452a-a8c0-5200986df877 req-28e48ff3-590b-4c87-a89b-fd3f8ee4ca91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde36abe-c87d-457c-b41a-040288d694da", "tag": "ebfe0ce8-aac6-476b-a756-32c12fac0eb3"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:56:28.895542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:28.895542 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:56:28.898367 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-b6af7b94-1b1b-4166-990d-bc204afe0448 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:28.900271 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b6af7b94-1b1b-4166-990d-bc204afe0448 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:28.909511 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-1f8933ef-7acb-452a-a8c0-5200986df877 req-28e48ff3-590b-4c87-a89b-fd3f8ee4ca91 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:28.910477 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-1f8933ef-7acb-452a-a8c0-5200986df877 req-28e48ff3-590b-4c87-a89b-fd3f8ee4ca91 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:28.914185 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b6af7b94-1b1b-4166-990d-bc204afe0448 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:28.914727 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b6af7b94-1b1b-4166-990d-bc204afe0448 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:28.915611 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b6af7b94-1b1b-4166-990d-bc204afe0448 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:28.916127 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-b6af7b94-1b1b-4166-990d-bc204afe0448 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:28.932600 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-1f8933ef-7acb-452a-a8c0-5200986df877 req-28e48ff3-590b-4c87-a89b-fd3f8ee4ca91 service nova] Creating event network-changed:ebfe0ce8-aac6-476b-a756-32c12fac0eb3 for instance bde36abe-c87d-457c-b41a-040288d694da on hv-cinder-82189 Dec 16 14:56:28.938692 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-1f8933ef-7acb-452a-a8c0-5200986df877 req-28e48ff3-590b-4c87-a89b-fd3f8ee4ca91 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057426 Dec 16 14:56:28.939773 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 588/1158] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:56:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:28.983710 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-b6af7b94-1b1b-4166-990d-bc204afe0448 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Going to try to terminate instance {{(pid=101915) delete /opt/stack/nova/nova/compute/api.py:2562}} Dec 16 14:56:29.125158 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-b6af7b94-1b1b-4166-990d-bc204afe0448 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 204 len: 0 microversion: 2.1 time: 0.247704 Dec 16 14:56:29.126545 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 571/1159] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:56:28 2021] DELETE /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:56:29.138658 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-2e99a83d-86e7-4808-baa3-16a1878e148c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:29.140054 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-2e99a83d-86e7-4808-baa3-16a1878e148c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:29.151228 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2e99a83d-86e7-4808-baa3-16a1878e148c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:29.152125 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2e99a83d-86e7-4808-baa3-16a1878e148c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:29.153478 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2e99a83d-86e7-4808-baa3-16a1878e148c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:29.154311 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-2e99a83d-86e7-4808-baa3-16a1878e148c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:29.671769 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.policy [None req-2e99a83d-86e7-4808-baa3-16a1878e148c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101914) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:56:29.684267 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-2e99a83d-86e7-4808-baa3-16a1878e148c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1575 microversion: 2.1 time: 0.551716 Dec 16 14:56:29.685250 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 589/1160] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:56:29 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1575 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:30.703344 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-7cfcfefa-6289-4050-8425-7c39354771c5 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:30.704170 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-7cfcfefa-6289-4050-8425-7c39354771c5 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:30.712051 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cfcfefa-6289-4050-8425-7c39354771c5 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:30.712501 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cfcfefa-6289-4050-8425-7c39354771c5 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:30.713316 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cfcfefa-6289-4050-8425-7c39354771c5 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:30.713756 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-7cfcfefa-6289-4050-8425-7c39354771c5 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:31.356855 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-7cfcfefa-6289-4050-8425-7c39354771c5 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:56:31.366401 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-7cfcfefa-6289-4050-8425-7c39354771c5 tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1457 microversion: 2.1 time: 0.667262 Dec 16 14:56:31.367302 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 572/1161] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:56:30 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1457 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:31.859269 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [req-21c130bb-5064-49d8-b72e-0a18d90e37a9 req-95d0eb0c-9b18-40bb-a3a2-ad99cb6dd9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde36abe-c87d-457c-b41a-040288d694da", "name": "network-vif-deleted", "tag": "ebfe0ce8-aac6-476b-a756-32c12fac0eb3"}]} {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 16 14:56:31.861662 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:31.861662 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: warnings.warn(msg) Dec 16 14:56:31.872505 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-21c130bb-5064-49d8-b72e-0a18d90e37a9 req-95d0eb0c-9b18-40bb-a3a2-ad99cb6dd9b0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:31.872950 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [req-21c130bb-5064-49d8-b72e-0a18d90e37a9 req-95d0eb0c-9b18-40bb-a3a2-ad99cb6dd9b0 service nova] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:31.892467 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.compute.server_external_events [req-21c130bb-5064-49d8-b72e-0a18d90e37a9 req-95d0eb0c-9b18-40bb-a3a2-ad99cb6dd9b0 service nova] Creating event network-vif-deleted:ebfe0ce8-aac6-476b-a756-32c12fac0eb3 for instance bde36abe-c87d-457c-b41a-040288d694da on hv-cinder-82189 Dec 16 14:56:31.897253 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [req-21c130bb-5064-49d8-b72e-0a18d90e37a9 req-95d0eb0c-9b18-40bb-a3a2-ad99cb6dd9b0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042520 Dec 16 14:56:31.897852 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 590/1162] 10.222.0.64 () {64 vars in 1317 bytes} [Thu Dec 16 14:56:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:32.384024 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:32.384634 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:32.392507 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:32.393063 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:32.393881 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:32.394320 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:32.480041 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:32.480401 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:32.480874 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.objects.instance [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lazy-loading 'fault' on Instance uuid bde36abe-c87d-457c-b41a-040288d694da {{(pid=101915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 14:56:32.573767 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.policy [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee703ae6a79f48cdb9438f504085e206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd963a0aa72964047885ee0212d5055dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101915) authorize /opt/stack/nova/nova/policy.py:199}} Dec 16 14:56:32.583443 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-f689c7e7-8ea6-47b0-a649-aa0ae1744d4b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 200 len: 1230 microversion: 2.1 time: 0.203659 Dec 16 14:56:32.584115 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 573/1163] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:56:32 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 1230 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:33.601705 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3a483d50-b330-4228-9b98-24fc98b3848b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:33.602393 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-3a483d50-b330-4228-9b98-24fc98b3848b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: bde36abe-c87d-457c-b41a-040288d694da] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:33.610653 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3a483d50-b330-4228-9b98-24fc98b3848b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:33.611106 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3a483d50-b330-4228-9b98-24fc98b3848b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:33.611930 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3a483d50-b330-4228-9b98-24fc98b3848b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:33.612354 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-3a483d50-b330-4228-9b98-24fc98b3848b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:33.662211 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-3a483d50-b330-4228-9b98-24fc98b3848b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] HTTP exception thrown: Instance bde36abe-c87d-457c-b41a-040288d694da could not be found. Dec 16 14:56:33.662816 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-3a483d50-b330-4228-9b98-24fc98b3848b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Returning 404 to user: Instance bde36abe-c87d-457c-b41a-040288d694da could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:56:33.663655 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-3a483d50-b330-4228-9b98-24fc98b3848b tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da" status: 404 len: 111 microversion: 2.1 time: 0.066184 Dec 16 14:56:33.664581 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 591/1164] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:56:33 2021] GET /compute/v2.1/servers/bde36abe-c87d-457c-b41a-040288d694da => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:56:34.602670 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ba0ae435-b85f-4ff4-b6d3-898492cd83fc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:34.603261 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.compute.api [None req-ba0ae435-b85f-4ff4-b6d3-898492cd83fc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101915) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:34.610982 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ba0ae435-b85f-4ff4-b6d3-898492cd83fc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:34.611433 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ba0ae435-b85f-4ff4-b6d3-898492cd83fc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:34.612245 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ba0ae435-b85f-4ff4-b6d3-898492cd83fc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:34.612682 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG oslo_concurrency.lockutils [None req-ba0ae435-b85f-4ff4-b6d3-898492cd83fc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:34.665523 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.wsgi [None req-ba0ae435-b85f-4ff4-b6d3-898492cd83fc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] HTTP exception thrown: Instance 2349104f-921f-4317-8b04-be3a09d2b6aa could not be found. Dec 16 14:56:34.666149 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-ba0ae435-b85f-4ff4-b6d3-898492cd83fc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Returning 404 to user: Instance 2349104f-921f-4317-8b04-be3a09d2b6aa could not be found. {{(pid=101915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:56:34.666990 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-ba0ae435-b85f-4ff4-b6d3-898492cd83fc tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 404 len: 111 microversion: 2.1 time: 0.068735 Dec 16 14:56:34.667544 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 574/1165] 10.222.0.64 () {58 vars in 1238 bytes} [Thu Dec 16 14:56:34 2021] DELETE /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:56:34.676296 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a7f7b607-5e95-459a-a414-d3a17fa3dc6c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '>' {{(pid=101914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:34.676910 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.compute.api [None req-a7f7b607-5e95-459a-a414-d3a17fa3dc6c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [instance: 2349104f-921f-4317-8b04-be3a09d2b6aa] Fetching instance by UUID {{(pid=101914) get /opt/stack/nova/nova/compute/api.py:2813}} Dec 16 14:56:34.684740 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a7f7b607-5e95-459a-a414-d3a17fa3dc6c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:34.685227 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a7f7b607-5e95-459a-a414-d3a17fa3dc6c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:34.686005 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a7f7b607-5e95-459a-a414-d3a17fa3dc6c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 14:56:34.686439 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG oslo_concurrency.lockutils [None req-a7f7b607-5e95-459a-a414-d3a17fa3dc6c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Lock "0f5f8018-539f-4757-94b5-f5fec5deb6e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 14:56:34.737639 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.wsgi [None req-a7f7b607-5e95-459a-a414-d3a17fa3dc6c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] HTTP exception thrown: Instance 2349104f-921f-4317-8b04-be3a09d2b6aa could not be found. Dec 16 14:56:34.738236 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: DEBUG nova.api.openstack.wsgi [None req-a7f7b607-5e95-459a-a414-d3a17fa3dc6c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Returning 404 to user: Instance 2349104f-921f-4317-8b04-be3a09d2b6aa could not be found. {{(pid=101914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 16 14:56:34.739082 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO nova.api.openstack.requestlog [None req-a7f7b607-5e95-459a-a414-d3a17fa3dc6c tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa" status: 404 len: 111 microversion: 2.1 time: 0.067016 Dec 16 14:56:34.739642 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: [pid: 101914|app: 0|req: 592/1166] 10.222.0.64 () {58 vars in 1235 bytes} [Thu Dec 16 14:56:34 2021] GET /compute/v2.1/servers/2349104f-921f-4317-8b04-be3a09d2b6aa => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:56:36.246432 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: DEBUG nova.api.openstack.wsgi [None req-cf936f49-f6f4-4d2d-b92a-9e36ec7cdc8d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] Calling method '.version_select at 0x7f3c2c4d3a60>' {{(pid=101915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 16 14:56:36.249935 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf936f49-f6f4-4d2d-b92a-9e36ec7cdc8d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [4b116eb2-6632-40a9-9560-684cba2b202a] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 14:56:37.268689 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf936f49-f6f4-4d2d-b92a-9e36ec7cdc8d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] [4b116eb2-6632-40a9-9560-684cba2b202a] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 59632. Dec 16 14:56:37.289866 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO nova.api.openstack.requestlog [None req-cf936f49-f6f4-4d2d-b92a-9e36ec7cdc8d tempest-TestVolumeBootPattern-588770667 tempest-TestVolumeBootPattern-588770667-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1174908289" status: 202 len: 0 microversion: 2.1 time: 1.047541 Dec 16 14:56:37.290437 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: [pid: 101915|app: 0|req: 575/1167] 10.222.0.64 () {58 vars in 1262 bytes} [Thu Dec 16 14:56:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1174908289 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:23.169727 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:57:23.170309 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: Thu Dec 16 14:57:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 14:57:42.737254 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:57:42.737894 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: Thu Dec 16 14:57:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 14:59:33.731033 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:59:33.731652 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: Thu Dec 16 14:59:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 14:59:36.645072 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:59:36.645812 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: Thu Dec 16 14:59:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 15:00:43.186950 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:00:43.187659 dv-cinder-821892-3-iscsi devstack@n-api.service[101914]: Thu Dec 16 15:00:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 15:01:02.756260 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:01:02.756916 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: Thu Dec 16 15:01:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 16 15:01:39.290295 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:01:39.291207 dv-cinder-821892-3-iscsi devstack@n-api.service[101915]: Thu Dec 16 15:01:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!